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This  report  describes  the  research  on  a  biological  visual  system  (BVS) 
based  sensor  with  possible  applications  to  robotics  and  automation.  The 
research  covers  the  period  October  1984  to  January  1985  and  was  performed 
by  two  principal  investigators,  a  participant  faculty  researcher  and  four  gra¬ 
duate  students  working  during  various  time  periods. 

The  report  covers  the  following  subjects: 

a)  sensor  configuration 

b)  edge  detection  modelling  for  the  human  visual  system  and  edge  detection 
using  the  BVS  sensor 

c)  qualitative  motion  detection  using  the  BVS 

d)  target  tracking  algorithms  for  the  BVS 

e)  microsaccadic  eye  movement  in  the  human  visual  system  (I1VS). 

These  five  subjects,  in  the  indicated  order,  constitute  the  five  chapters  of 
the  report. 

The  fundamental  properties  of  a  sensor  emulating  the  configuration  of 
the  HVS  sensor  have  been  discussed  previously  by  other  researchers  and  are 
reviewed  briefly  in  pertinent  sections  of  Chapters  I  and  II.  It  is  convenient, 
however,  to  define  the  basic  nomenclature  and  notation  at  this  point. 

The  light  sensitive  array  of  elements  equivalent  to  the  retina  in  the  BVS 
sensor  is  named  the  "image  plane"  and  described  mathematically  by  a  com¬ 
plex  plane, 

z  =  x  +  jy 
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It  is  believed  that  the  information  transmitted  from  the  retina  to  the 
cerebral  cortex  in  the  BVS  undergoes  some  preprocessing  before  reaching  the 
cerebral  cortex.  However,  in  the  proposed  sensor  we  assume  direct  mapping 
from  the  image  plane  to  the  computation  plane,  also  a  complex  plane 

w  =  u  +  jv 

The  mapping  is  a  conformal  transformation  given  by 

w  =  In  (z  ) 

=  Zn(re^) 

=  lnr  +  /'0 

In  other  words, 

u  =  lnr 

where  r  is  the  norm  of  z,  and 

v  =  0 

where  0  is  the  phase  of  z. 

The  above  relations  show  that  if  an  image  is  magnified  with  respect  to 
the  optical  axis,  its  shape  in  computation  plane  remains  invariant  with  only 
a  shifting  along  the  real  axis  u. 

Similarly,  if  an  image  is  rotated  with  respect  to  the  optical  axis  in 
image  plane,  its  shape  remains  invariant  in  computation  plane  with  a  shifting 
along  the  imaginary  axis  v. 

The  fact  that  we  are  assuming  direct  mapping  from  image  plane  to  com¬ 
putation  plane  does  not  mean  that  in  the  course  of  further  research  we  could 
not  consider  preprocessing  operations  taking  place  between  the  two  planes. 
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In  Chapter  I,  three  different  configurations  for  the  image  plane  are  con¬ 
sidered:  "rectangular  elements"  (actually  arcs  of  rings),  circular  elements  and 
hexagonal  elements.  Rectangular  elements  consist  of  arcs  of  rings  with 
exponentially  increasing  diameter  which  map  to  a  true  rectangular  array  in 
computation  plane.  The  circular  element  configuration  consists  of  concentric 
rings  each  with  the  same  number  of  circular  elements  increasing  exponentially 
in  diameter  which  map  to  computation  plane  as  columns  of  circles,  all  of  the 
same  size.  The  hexagonal  element  array  is  similar  to  the  circular  case,  but 
with  hexagonal  elements  mapping  to  columns  of  equal  size  hexagons  in  the 
computation  plane.  Design  rules  are  developed  relating  the  number  of  ele¬ 
ments  per  ring  to  the  number  of  rings  and  "fovea"  size.  The  fovea  is  the 
small  circular  region  at  the  center  of  the  image  plane  where,  for  the 
moment,  no  elements  are  placed.  Advantages  and  disadvantages  of  each 
configuration  are  discussed  and  simulations  are  performed  using  images 
obtained  with  a  conventional  camera.  The  savings  in  processing  time  stem¬ 
ming  from  the  enormous  reduction  in  the  number  of  pixels  is  quantitatively 
discussed. 

Fundamental  properties  of  the  peripheral  HVS  are  discussed  in  Chapter 
II,  especially  those  relevant  to  edge  detection.  A  mathematical  model  for 
HVS  system  edge  detection  is  discussed  in  detail  and  a  simplified  but  accu¬ 
rate  mathematical  expression  of  this  model  is  used  for  edge  detection  simula¬ 
tion  using  real  images.  Algorithms  for  edge  detection  for  the  BVS  sensor 
with  hexagonal  and  circular  elements  are  developed  and  applied  to  real 
images.  The  results  are  very  similar  to  those  obtained  with  the  models  pro¬ 
posed  for  the  HVS. 
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In  Chapter  III  the  properties  of  the  logarithmic  conformal  transformation 
are  used  to  analyze  edge  images  of  various  objects  and  to  determine  proper¬ 
ties  that  allow  estimation  of  the  direction  of  motion  for  the  following  cases: 
scaling  (magnification)  and  rotation  about  the  optical  axis  (OA)  of  objects 
enclosing  and  not  enclosing  the  OA;  translation  of  objects  enclosing  the  OA. 
The  algorithm  works  for  both  geometric  and  random  figures  and  its 
automatic  implementation  by  means  of  a  computer  program  that  will  indicate 
the  type  of  motion  is  now  in  progress.  The  algorithm  needs  to  be  extended 
to  include  translation  of  objects  not  enclosing  the  OA. 

Chapter  IV  considers  the  quantitative  estimation  of  target  perturbation 
using  two  different  techniques.  In  the  first  one  the  difference  of  the  loga¬ 
rithmic  function  between  two  consecutive  frames  is  linearized  and  estimated 
values  for  the  displacement  are  obtained  using  the  minimum  mean  square 
error.  This  technique  works  well  and  simulations  confirm  the  accuracy  of 
the  estimation.  However  it  presupposes  that  the  correspondence  problem  has 
been  solved,  i.e.,  that  it  is  known  that  two  points  correspond  to  each  other 
in  the  two  images.  The  second  technique,  based  in  the  intensity  function, 
does  not  require  a  solution  to  the  correspondence  problem  and  a  relatively 
simple  recursive  algorithm  is  developed  to  estimate  the  displacement  vector. 
However,  due  to  the  non  uniform  sampling  (in  other  words  the  different  pixel 
size)  of  the  BVS  sensor,  a  point  with  a  given  intensity  in  a  frame  will  not 
correspond  to  a  point  with  the  same  intensity  in  the  next  frame  even  when 
the  image  would  have  the  same  illumination  in  both  frames.  Consequently, 
the  algorithm  as  developed  in  Chapter  IV  does  not  perform  adequately  in 
simulations.  Its  modification  to  take  into  account  the  nonuniform  sampling 


is  currently  under  consideration. 

In  Chapter  V,  the  hypothesis  that  microsaccades  sweep  visual  stimuli 
across  several  receptors  in  the  fovea  is  pursued.  This  hypothesis  is  sup¬ 
ported  by  other  researchers.  If  the  hypothesis  is  true,  fault  tolerant  sensor 
systems  can  be  developed  because  an  inoperative  "pixel"  output  can  be 
replaced  with  a  combination  of  its  neighbors.  The  technique  could  also  be 
used  for  local  sensor  calibration.  This  is  the  only  chapter  in  which,  for  the 
moment,  the  fovea  region  has  been  considered.  Further  research  on  the  BVS 
sensor  will  require  consideration  of  the  fovea  region  which  has  a  uniform 
distribution  of  elements,  in  addition  to  the  region  outside  the  fovea  con¬ 
sidered  in  this  report,  with  its  log  spiral  distribution  of  elements.  The  role 
played  by  the  fovea,  as  well  as  previously  unexpressed  characteristics  of  the 
external  region,  will  have  to  be  considered  and  included  in  the  BVS  sensor. 
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Original  image:  noisy  photograph 
Image  after  edge  detection,  image  plane 
Image  after  edge  detection,  computation  plane 
Zero  crossing  edges,  image  plane 
Zero  crossing  edges,  computation  plane 

Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113 
by  51  Sampling  Points 

Image  after  edge  detection,  image  plane 

Image  after  edge  detection,  computation  plane 

Zero  crossing  edges,  image  plane,  no  thresholding 

Zero  crossing  edges,  image  plane,  thresholding  -  20 

Zero  crossing  edges,  computation  plane,  no  thresholding 

Zero  crossing  edges,  computation  plane,  thresholding  -  20 

Block  diagram  of  image  processing  procedure  for  the  new  sen¬ 
sors 

Circular  elements  and  hexagonal  elements  neighborhoods  in  com¬ 
putation  plane 

Block  diagram  of  the  Laplacian  operation 


Fig  D.17  Block  diagram  of  the  general  edge  detection  scheme 

Fig  11.18  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor 

(34  Rings  74  Elements  per  Ring) 

Fig  11.18(a)  Original  image:  white  square  on  black  background 
Fig  11.18(b)  Mapping  of  image  to  computation  plane 

Fig  11.18(c)  Edge  detection  in  computation  plane  by  absolute  value 
method  and  no  thresholding 

Fig  11.18(d)  Edge  detection  in  CP  by  absolute  value  method;  threshold  - 
120 

Fig  11.18(e)  Edge  detection  in  CP  by  Laplacian  method,  no  thresholding 

Fig  11.18(f)  Edge  detection  in  CP  by  Laplacian-Gaussian  method,  no  thres¬ 
holding 

Fig  11.19  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor 
(34  Rings,  74  Elements  per  Ring) 

Fig  11.19(a)  Original  grey  level  image:  dark  frame  on  light  background 
Fig  II.  19.(b)  Mapping  of  image  to  CP 

Fig  11.19(c)  Edge  detection  in  CP  by  absolute  value  method;  threshold  - 
190 

Fig  11.19(d)  Edge  detection  in  CP  by  Laplacian  method;  threshold  =  30 

Fig  11.19(e)  Edge  detection  in  CP  by  Laplacian-Gaussian  method,  no  thres¬ 
holding 

Fig  11.20  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor 

(34  Rings,  74  Elements  per  Ring). 

Fig  11.20(a)  Original  image 

Fig  11.20(b)  Simulated  circular-element  sensor  image 

Fig  11.20(c)  Mapping  of  image  to  computation  plane 

Fig  11.20(d)  Edge  image  in  CP,  absolute  value  method,  threshold  =  75 

Fig  11.20(e)  Edge  image  in  CP,  Laplacian  method,  threshold  -  20 

Fig  11.20(f)  Edge  image  in  CP,  Lapacian-Gaussian  method,  no  thresholding 

Fig  11.21  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor 

(55  Rings,  113  Elements  per  Ring). 

Fig  11.21  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor 

(55  Rings,  113  Elements  per  Ring). 

Fig  11.21(a)  Simulated  circular-element  sensor  image 

Fig  11.21(b)  Mapping  of  image  to  computation  plane 

Fig  11.21(c)  Edge  image  in  CP,  absolute  value  method,  threshold  -  55 

Fig  11.21(d)  Edge  image  in  CP,  Laplacian  method,  threshold  -  15 

Fig  11.21(e)  Edge  image  in  CP,  Laplacian-Gaussian,  no  thresholding 

Fig  III.  1  Random  figure  in  image  plane 

Fig  III.  1(a)  Random  figure  edge  In  computation  plane 
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(A)  Original;  (B)  Figure  magnified  by  m-2  about  optical  axis  in 
IP 

Random  figure  edge  in  computation  plane 

(A)  Original;  (B)  Figure  rotated  by  +45°  about  optical  axis  in 
IP 

Ellipse:  (a)  Original,  A  and  magnified  by  2.3,  B;  (b)  Original,  A 
and  scaled  by  0.8,  B. 

Random  figure:  (a)  Original,  A  and  rotated  by  +30°,  B;  (b)  Ori¬ 
ginal,  A  and  rotated  by  -30°,  B. 

Random  figure  edge  in  CP:  (A)  Original;  (B)  Magnified  by  m=2 
and  rotated  by  a-+45°  both  about  optical  axis 

Random  figure  edge  in  CP:  (A)  Original;  (B)  Translated  by 
yu.-0.3  in  IP. 

Mapping  of  off-center,  by  (4,4)  units,  random  figure. 

(A)  m-1;  (B)  m^D.8 

Mapping  of  off-center,  by  (4,4)  units,  random  figure. 

(A)  m-0.8,  (B)  m-1,  (C)  m-1. 2 

Mapping  of  off-center,  by  (4,4)  units,  random  figure.  (A)  m-1; 

(B)  m-1. 2 

Mapping  of  off-center,  by  (4,4)  units,  random  figure.  (A)  m-1, 
a=0;  (B)  m-1,  a-+3(T 

Mapping  of  off-center,  by  (4,4)  units,  random  figure. 

(A)  m-1,  or-0;  (B)  m-1.2,  c*-20° 

Mapping  of  off-center,  by  (4,4)  units,  random  figure. 

(A)  m-1,  <*-0;  (B)  m-2,  a-30° 

Centered  square  and  off-center  rectangle  in  image  plane 
Mapping  of  the  two  objects  in  Fig  12(a)  to  the  CP. 

Mapping  of  Fig  12(a)  to  CP. 

(A)  Original;  (B)  m-1,  a-+15° 

Mapping  of  Fig  12(a)  to  CP. 

(A)  Original;  (B)  m-1.2,  or=0 
Mapping  of  Fig  12(a)  to  CP. 

(A)  Original;  (B)  m-1.2,  a-45° 

Circle  with  r-6;  edge  in  CP. 

(a)  (A)  Centered;  (B)  off-center  by  (0.8,  0.6)  in  IP 

(b)  (A)  Centered;  (B)  off-center  by  (-0.6,  -0.8)  in  IP 
Square  with  side  -2;  edge  in  CP. 

(a)  (A)  Centered,  (B)  off-center  by  (-0.4,  0.5)  in  IP 

(b)  (A)  Centered,  (B)  off-center  by  (0,  0.5)  in  IP 
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GLOSSARY 


Computational  Plane  (CP)  -  the  plane  onto  which  the  image  is  mapped  under  the 
conformal  logarithmic  transformation. 

Current  Image  (Cl)  -  the  second  (most  recent)  image  in  a  two-frame  image 
sequence. 

Difference  Image  (DI)  -  the  difference  between  the  current  image  and  the  previous 
image,  in  a  two-frame  image  sequence,  obtained  in  the  computation  plane. 

Difference  of  Gaussians  (DOG)  -  a  function  consisting  of  the  difference  of  two 
Gaussian  distributions.  It  is  thought  that  DOG  functions  describe  the  shape  of  the 
retinal  ganglion  cells  receptive  fields. 

Eccentricity  -  In  the  human  visual  system,  the  distance  from  the  center  of  the 
fovea  to  the  center  of  a  receptive  field;  in  an  artificial  sensor,  the  distance  from  the 
optical  axis,  i.e.  the  center  of  the  image,  to  a  point  or  pixel  in  the  image.  Usually 
expressed  in  degrees. 

Eight-neighborhood  -  area  of  an  image  in  which  the  pixel  under  consideration  is 
surrounded  by  eight  other  pixels.  It  is  used  in  conventional  rectangular  arrays. 

Field  of  view  (FOV)  -  the  slide  angle  covered  by  the  lens  system  of  a  vision  sys¬ 
tem;  in  cameras,  the  part  of  the  scene  projected  to  the  light-sensitive  sensor. 

Fovea  -  the  central  part  of  the  retina  in  which  cones  are  densely  packed  and  no 
rods  are  present;  it  is  the  area  where  visual  acuity  in  humans  is  greatest.  In  an 
artificial  sensor,  the  circular  part  of  the  center  where  receptive  fields  do  not  follow 
the  log-spiral  configuration. 


Frame  -  one  image  in  a  sequence  obtained  by  a  camera  (TV  or  movies). 

Frame  difference  -  the  difference  between  the  images  of  two  frames,  not  necessarily 

two  consecutive  frames. 

Gaussian  (G)  -  the  normal  probability  distribution  function,  p(x)  =  (l/V27r)e-*2/tf2. 

Image  Plane  (DP)  -  the  plane  where  the  actual  image  is  formed;  the  retina  in  the 

eye,  the  film  in  a  photographic  camera,  and  the  CCD  array  in  a  solid  state  TV 

camera. 

Inter-ring  spacing  -  the  exponentially  increasing  space  between  rings  of  elements  in 
the  image  plane  of  the  BVS  sensor. 

Laplacian  -  a  mathematical  operation  representing  the  divergence  of  the  gradient  of 
a  scalar  quantity;  mathematically,  in  two  dimensions,  in  rectangular  cartesian  coor¬ 
dinates,  the  Laplacian  operator  is  V2  =  S/2^*2  +  d^dy2- 

Lateral  Geniculate  Nucleus  (LGN)  -  the  main  visual  nucleus  between  the  eye  and 
the  brain.  It  is  fed  by  the  optic  nerve,  which  consists  of  axons  of  the  retinal  gan¬ 
glion  cells.  The  axons  emerging  from  the  LGN,  called  the  optic  radiations,  project 
to  the  striate  cortex  in  man. 

Motoneurons  -  neurons  which  carry  impulses  controlling  muscle  contractions. 
Myocardial  -  pertaining  to  the  muscles  or  muscle  tissue. 


Number  of  points  -  the  number  of  discrete  points,  or  pixels,  resulting  from  the 
difference  between  the  current  and  the  previous  images  in  binary  form. 


Periphery  -  the  outer  part  of  the  retina  or  of  the  image  plane,  where  the  log- 
spiral  structure  is  found. 

Pixel  -  a  term  formed  from  the  words  picture-element;  it  means  each  one  of  the 
discrete  light  sensitive  elements  in  the  sensor  of  a  CCD  camera,  or  the  quantized 
elements  formed  from  the  scan  lines  of  a  vidicon  camera. 

Pixel  fitting  -  the  process  of  fitting  small  rectangular  pixels  into  larger  pixels  of  a 
different  shape  for  simulation  purposes. 

Previous  image  -  in  a  sequence  of  two  consecutive  frames,  the  first  of  the  two 
frames,  followed  by  the  ’current  image’  or  second  frame. 

Reticulate  formation  -  a  portion  of  the  brain  containing  elements  which  play  a 
role  in  the  formation  of  conditioned  reflexes,  the  regulation  of  sensory  input,  and 
consciousness. 

Retinal  ganglion  cells  -  the  final  layer  of  cells  in  retinal  processing. 

Retinotopic  -  concerning  the  arrangement  of  receptive  fields  on  the  retina;  in  the 
peripheral  field,  the  resolution  decreases  with  eccentricity. 

Rigid  motion  -  a  simple  type  of  motion  in  which  all  the  objects  in  a  scene  move 
with  the  same  velocity. 

Scotoma  -  a  blind  spot  in  the  retina  due  to  disease  or  injury  (not  the  "blind 
spot"). 

Six-neighborhood  -  area  of  an  image  in  which  the  pixel  under  consideration  is  sur¬ 
rounded  by  six  other  pixels.  It  is  found  in  hexagonal  or  circular  grid 
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configurations. 


Striate  cortex  -  the  primary  cortical  receiving  area  in  man. 

Template  matching  -  a  pattern  recognition  technique  in  which  an  image  is  com 
pared  to  a  template  stored  in  memory  (in  digital  form)  for  identification  purposes. 

X  cells  and  Y  cells  -  the  two  classes  of  retinal  ganglion  cells. 

Zero-crossing  -  point  at  which  a  function’s  value  changes  its  sign. 
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CHAPTER  I.  ANALYSIS  OF  GEOMETRIC  CONFIGURATIONS 

1.1.  Introduction 

One  of  the  major  problems  with  practical  machine  vision  systems  is  the 
time  involved  in  obtaining  and  processing  images.  The  objective  of  this 
research  project  is  to  use  several  properties  of  biological  vision  systems  (BVS) 
in  the  design  of  a  new  sensor  which  will  reduce  processing  time  in  many 
machine  vision  applications.  Current  results  indicate  that  these  novel  ideas 
will  indeed  be  useful  in  a  variety  of  industrial,  scientific,  and  military  appli¬ 
cations. 

There  are  three  basic  features  of  the  eye  that  are  being  investigated  for 
application  to  the  new  machine  vision  system.  The  first  of  these  is  the 
actual  structure  of  the  retina,  the  second  is  the  preprocessing  in  hardware, 
and  the  third  is  the  conformal  mapping  into  the  computational  space  in  the 
cerebral  cortex.  Each  of  these  has  characteristics  that  will  make  some  tasks 
performed  by  machine  vision  systems  easier  or  faster. 

For  many  years,  the  organization  of  light  sensitive  receptors  in  the 
retina  has  been  known.  Over  a  hundred  years  ago,  Shultze  [l]  discovered 
that  the  receptive  fields  in  the  retina  increase  linearly  in  diameter  with 
increasing  eccentricity,  Fig.  1.1.  Later  studies  [2]  confirm  this  early  work 
and  help  to  demonstrate  that  an  image  formed  on  the  retina  undergoes  a 
complex  logarithmic  conformal  mapping  into  the  cerebral  cortex,  as  a  result 
of  the  geometric  configuration  of  the  receptive  fields. 

This  structure  allows  usable  information  to  be  obtained  using  a 
significantly  smaller  number  of  pixels  (light  sensitive  elements)  than  that 
necessary  in  conventional  sensors  [3].  Since  the  elements  in  the  retina 
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Figure  1.1.  Schultze’s  Model  of  the  Retina. 


increase  in  size  with  increasing  radius,  the  outer  elements  are  much  larger 


than  the  inner  ones;  but,  in  a  conventional  sensor  the  elements  are  of  uni¬ 


form  size  regardless  of  location,  causing  a  much  greater  number  to  be  used, 


Fig.  1.2.  If  a  machine  vision  sensor  is  constructed  that  has  a  structure  simi¬ 


lar  to  that  of  the  retina,  a  considerable  savings  will  result  in  terms  of  the 


number  of  elements  necessary  to  produce  a  given  resolution  near  he  center 


of  the  array.  Since  fewer  elements  are  being  used,  any  manipulation  of  the 


image  data  will  be  correspondingly  faster. 
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The  second  area  of  interest  is  the  hardware  preprocessing  that  is  done  in 
BVS  between  the  retina  and  the  cortex.  It  appears  that  many  common 
image  processing  tasks  are  performed  before  the  information  reaches  the  brain 
in  many  biological  systems  [4],  The  retinal  interconnections  between  cells  in 
the  periphery  of  the  retina  may  be  useful  in  such  image  processing  tasks  as 
edge  and  motion  detection  [5]. 

Performing  edge  and  motion  detection  in  hardware  as  in  BVS  using  the 
properties  of  the  BVS  sensor  should  produce  a  large  increase  in  speed  over  a 
conventional  software  image  processing  scheme,  and  even  over  hardware  sys¬ 
tems  based  on  the  conventional  sensor.  Specialized  hardware  such  as  that  in 
the  eye  could  greatly  reduce  the  complexity  of  now  complicated  situations, 
and  make  many  machine  vision  applications  much  simpler. 


-4- 


The  final  aspect  of  BVS  that  we  are  interested  in  is  the  mapping  that 
occurs  between  the  retina  and  the  cerebral  cortex.  Several  studies  [6]  [7] 
have  demonstrated  that  the  arrangement  of  the  receptive  fields  in  the  eye  is 
transferred  into  the  brain  by  means  of  a  complex  conformal  mapping.  This 
mapping,  called  the  logarithmic  spiral  mapping  (LSM),  is  circularly  sym¬ 
metric  about  the  center  of  the  eye  and  transforms  radial  lines  of  constant 
angle  into  horizontal  lines  in  the  computational  plane,  and  circles  about  the 
center  of  the  image  plane  into  vertical  lines  placed  according  to  the  natural 
logarithm  of  the  circle’s  radius  in  the  computational  plane  [8]. 

The  LSM  exhibits  several  features  that  may  be  very  useful  in  machine 
vision  systems.  The  first  of  these  is  a  form  invariance  under  magnification, 
which  means  that  if  an  object  in  the  image  plane  is  magnified  about  the  opt¬ 
ical  axis,  the  shape  of  the  object  in  the  computational  plane  does  not  change, 
it  only  moves  horizontally,  Fig.  1.3.  The  second  feature  is  form  invariance 
under  rotation,  which  is  similar  to  the  previous  one  in  that  if  the  object  is 
rotated  about  the  optical  axis  in  the  image  plane,  the  shape  in  the  computa¬ 
tional  plane  does  not  change,  it  only  moves  \  jrtically,  Fig.  1.4.  The  last  of 
these  features  is  a  built  in  resistance  to  noise  that  is  due  to  the  increasing 
size  of  the  sensors  in  the  periphery. 

If  these  features  can  be  properly  used,  they  could  greatly  simplify  tasks 
such  as  template  matching  or  simple  object  identification.  This  would  help 
to  make  many  machine  vision  applications  more  feasible  from  a  processing 
time  standpoint  [9],  an  important  consideration  for  real  time  applications. 


actually  superimposed 
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z  plane 
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Figure  1.4.  Example  of  Form  Invariance  Under  Rotation. 


Given  the  diversity  and  quantity  of  basic  research  to  be  conducted,  it 
was  necessary  to  separate  this  project  into  several  related  parts,  each  to  be 
conducted  by  different  members  of  the  research  team.  The  area  of  investiga¬ 
tion  described  in  this  chapter  concerns  the  actual  architecture  of  the  sensor  — 
to  examine  the  structure  and  arrangement  of  the  receptive  fields  (retina)  and 
its  mapping  into  the  computational  space,  then  to  simulate  this  structure  and 
test  it  to  determine  whether  it  behaves  as  predicted  and  can  indeed  be  used 
as  intended. 


The  work  was  divided  into  three  interrelated  areas,  the  first  of  which 
was  an  extensive  literature  search  to  provide  a  starting  point  from  which  to 
begin  simulations  of  the  biological  vision  system.  This  literature  search  pro¬ 
vided  valuable  insight  into  previous  work  and  allowed  a  decision  to  be  made 
about  the  proper  structures  to  simulate.  The  second  aspect  of  this  part  of 
the  project  was  a  detailed  analysis  of  the  geometry  of  the  structures 
intended  for  simulation,  both  the  image  plane  configuration  and  the  computa¬ 
tionally  mapped  image.  The  final  part  was  the  actual  simulation  of  the 
structures. 

1.2.  Literature  Search 

This  section  contains  a  discussion  of  the  results  of  the  literature  search 
that  was  conducted  prior  to  and  during  the  other  parts  of  the  work. 
Important  findings  will  be  cited,  and  explanations  about  their  usefulness  will 
be  provided. 

The  material  in  this  area  is  broken  up  into  four  loose  groups,  each  of 
which  has  a  definite  part  in  this  project.  The  four  classifications  are 
physiology/psychology,  engineering  applications,  hexagonal  structures,  and 
image  sensor  devices.  In  each  group,  articles  and  papers  relevant  to  the 
research  were  obtained. 

The  physiological/ psychological  papers  were  fairly  useful  in  increasing 
the  investigator’s  understanding  of  the  function  and  organization  of  the 
retina,  the  connecting  structures,  and  the  cortex.  Starting  with  the  paper  by 
Schultze  [1],  there  was  a  good  deal  of  information  in  this  area. 
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Schwartz  has  published  several  papers  [6],  [10]  about  the  features  of 
biological  vision  systems,  including  the  characteristics  in  which  we  are  most 
interested.  His  papers  seem  to  support  the  direction  that  we  have  assumed, 
and  provide  a  general  physiological  basis  for  our  work.  He  is  involved  with 
research  into  the  retinotopic  mapping  and  the  form  invariance  properties. 

Many  of  the  most  important  physiological/ psychological  papers  were 
cited  in  Section  I.I.,  such  as  the  paper  by  Daniel  and  Whitteridge  [2],  which 
supports  a  great  deal  of  the  work  done  by  Schwartz  and  others.  Another 
good  general  paper  is  the  one  by  Michael  [5],  which  gives  a  basic  description 
of  the  biological  vision  system  and  its  functions.  The  paper  by  Lettvin,  et 
al  [4]  was  of  use  in  understanding  the  processes  that  can  be  done  in 
hardware  before  sending  the  information  to  the  brain. 

Unfortunately,  an  engineering  oriented  education  leaves  little  time  for 
physiology  or  psychology,  so  many  of  the  articles  that  may  have  been  help¬ 
ful  were  so  medically  oriented  that  no  useful  information  could  be  gained 
from  them.  The  engineering  applications  papers  were  quite  a  bit  more  help¬ 
ful. 

The  most  important  of  the  engineering  papers  have  already  been  cited, 
particularly  the  papers  by  Sandini  and  Tagliasco  [3]  and  Braccini,  et  al  [9]. 
There  is  a  second  paper  by  Braccini’s  group  [11],  that  supports  and  builds  on 
the  previous  material.  The  Weiman  and  Chaikin  [7],  [8]  papers  were  essen¬ 
tially  similar  to  the  ones  above,  and  there  is  a  third  [12]  that  is  based  on 
|  [7]  and  [8].  The  Weiman  and  Chaikin  material  supports  the  idea  of  a 

machine  vision  system  based  on  the  biological  vision  system.  Another 

! 


-9- 


engineering  oriented  paper  by  Jain  [13],  suggests  the  same  type  of  sensor  as 
the  others.  Finally,  the  work  of  Messner  and  Szu  [14],  [15],  and  [16]  also 
contributes  to  the  knowledge  in  this  area,  although  it  contains  relatively  lit¬ 
tle  new  material. 

The  third  group,  hexagonal  structures,  is  important  because  the  arrange¬ 
ment  of  the  elements  in  the  image  and  computational  planes  can  be  hexago¬ 
nal,  in  which  case,  the  computational  plane’s  elements  are  in  a  six  neighbor¬ 
hood  as  opposed  to  the  eight  neighborhood  found  in  standard  rectangular 
arrays.  This  forms  a  hexagonal  lattice,  where  normal  image  processing  tech¬ 
niques  do  not  apply.  The  hexagonal  structures  papers  address  the  use  of 
hexagonal  structures  in  image  processing. 

A  paper  by  Scholten  and  Wilson  [17]  discusses  the  use  of  hexagonal  lat¬ 
tices  in  the  chain  coding  of  line  images.  Their  findings  indicate  that  not 

only  are  hexagonal  lattices  useful,  but  they  consistently  outperform  conven¬ 
tional  rectangular  grids.  Golay  [18]  found  that  hexagonal  grids  were  very 
useful  for  some  applications,  but  he  had  doubts  about  their  use  in  situations 
where  the  orientation  of  the  image  was  important.  Yajima  [19]  and  his 
group  demonstrated  that  Golay ’s  doubts  were  unfounded,  because  they 
achieved  approximately  60%  data  compression  of  oriented  images  using  a 
similar  structure.  Others  doing  similar  work  are  Burt  [20]  and  Mersereau 
[21],  whose  findings  indicate  that  the  hexagonal  lattice  will  be  at  least  as 

good  as  a  rectangular  lattice,  thus  reinforcing  the  usefulness  of  the  proposed 


sensor. 
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The  last  category,  image  sensor  devices,  was  investigated  to  gain 
knowledge  about  what  technology  was  available,  and  what  would  be  the  best 
choice  for  our  sensor.  Since  General  Electric  has  done  a  great  deal  of  this 
type  of  research,  several  papers  about  their  technology  were  available.  A 
paper  by  Sachs  [22]  gives  an  overview  of  the  devices  currently  in  use  in 
industry.  Charge  Injection  Devices  are  discussed  in  a  paper  by  Carbone  and 
Hunter  [23]  and  Carbone  also  has  a  paper  on  solid  state  sensors  in  general 
[24]. 

The  literature  indicates  that  there  is  a  wide  variety  of  possible  technolo¬ 
gies  available.  Unfortunately,  it  seems  that  the  overwhelming  majority  of 
cameras  today  have  square  or  rectangular  light  sensitive  elements,  whereas 
the  proposed  sensor  would  have  either  arc-of-ring,  circular,  or  hexagonal  ele¬ 
ments.  This  is  not  a  problem  with  the  actual  construction  of  the  sensor, 
but  it  may  be  that  existing  computer  aided  design  tools  will  not  allow  such 
shapes  when  designing  the  semiconductor  masks. 

The  literature  also  shows  that  conventional  sensors  have  straight  line 
routings,  either  parallel  or  perpendicular  only.  The  proposed  sensor  may 
require  curved  lines  and  routings  that  are  no  longer  parallel  or  perpendicular. 
Again,  this  problem  will  be  at  its  most  severe  during  the  design  of  the 
masks  which,  once  complete,  will  allow  the  construction  to  proceed  nor¬ 


mally. 
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1.3.  Geometric  Considerations 

There  are  a  great  number  of  questions  to  be  answered,  about  the 
geometry  of  the  retina  and  the  mapping.  The  basic  idea  is  to  build  on  the 
fundamental  concepts  found  throughout  the  literature  and  construct  several 
simulations  of  different  structures  to  indicate  which  would  best  suit  the 
design  objective.  From  this  starting  point,  it  was  fairly  easy  to  decide  that 
there  were  really  only  three  feasible  structures  to  consider,  which  are  called 
rectangular  elements,  circular  elements,  and  hexagonal  elements.  Each  of 
these  structures  has  advantages  and  disadvantages,  and  part  of  the  purpose  of 
this  section  is  to  discuss  these  advantages  and  disadvantages. 

The  geometry  of  these  structures  is  important  not  only  in  itself,  but 
also  as  a  part  of  the  simulation  of  these  structures.  It  is  important  to  real¬ 
ize  that  in  order  to  evaluate  the  proposed  structure  without  actually  con¬ 
structing  it,  it  must  be  simulated  using  a  normal  rectangular  array  camera. 
In  order  to  do  this,  the  exact  geometry  of  each  element  in  the  proposed 
structure  must  be  known. 

The  first  and  simplest  of  the  three  possible  structures  is  the  rectangular 
element  case,  which  consists  of  exponentially  spaced  concentric  rings,  each 
with  the  same  number  of  elements.  This  image  plane  configuration  maps 
into  a  rectangular  array  of  elements  in  the  computational  plane,  Fig.  1.5. 

This  structure  has  many  advantages,  not  the  least  of  which  is  its  sim¬ 
plicity.  The  concentric  circles  and  radial  lines  make  it  very  easy  to  simulate 
using  a  conventional  rectangular  array.  Its  design  and  construction  are  also 
simpler  than  the  other  two.  Since  lines  and  circles  are  easy  to  write 


Figure  1.5.  Image  and  Computational  Planes  iectangular  Elements. 


equations  for,  the  problem  of  pixel  fitting  a  square  array  onto  this  structure 
becomes  correspondingly  easier. 

The  fact  that  this  architecture  maps  into  a  rectangular  array  under  the 
LSM  allows  the  use  of  existing  image  processing  techniques.  The  Sobel 
operator  for  edge  detection,  for  example,  can  be  used  to  detect  edges  in  the 
computational  plane  in  the  conventional  way.  Of  course  the  results  will  be 
obtained  much  faster  (fewer  elements),  and  they  will  have  vastly  different 
meanings  (horizontal  lines  in  the  computational  plane  mean  radial  lines  in  the 
image  plane  and  vertical  lines  mean  circles  in  the  image  plane),  but  no  major 


rethinking  of  image  processing  techniques  will  be  necessary. 

Rectangular  elements  have  several  design  advantages  over  the  other 
schemes.  The  shape  of  the  elements  is  like  that  of  existing  sensors,  whose 
elements  are  square  or  rectangular  in  shape.  This  may  be  of  importance  in 
the  design  and  layout  of  the  actual  sensor.  Both  the  number  of  elements 
and  the  inter-ring  spacing  can  be  controlled,  allowing  more  selectivity  in 
terms  of  resolution  over  the  other  two  structures. 

In  the  circular  and  hexagonal  element  cases  the  spacing  between  the  rings 
is  determined  by  the  geometry  of  the  sensor,  while  in  the  rectangular  case  it 
is  up  to  the  designer.  This  will  allow  the  selection  of  the  size  change 
between  rings.  Fig.  1.6.  Another  advantage  of  the  rectangular  elements  is  the 
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straight  lines  running  from  the  center  of  the  array  to  the  outside.  In  the 
actual  sensor  these  may  make  line  routings  easier. 

The  only  real  disadvantage  of  this  structure  is  that  it  is  the  least  simi¬ 
lar  to  the  actual  structure  of  the  eye.  Both  of  the  other  arrangements 
approximate  better  the  actual  retinal  structure.  What  is  meant  by  this  is 
that  the  arrangement  of  the  receptive  fields  in  the  retina  more  closely  resem¬ 
bles  either  of  the  other  two  structures. 

The  second  of  the  three  possible  structures  is  the  circular  element  case, 
which  consists  of  concentric  rings  of  increasing  radius,  each  with  the  same 
number  of  circular  elements.  Each  ring  is  offset  from  its  two  nearest  neigh¬ 
bors,  so  that  the  elements  in  each  ring  touch  along  a  circle.  This  structure 
maps  into  the  computational  plane  as  columns  of  circles,  with  each  column 
offset  from  its  two  nearest  neighbors.  All  of  the  elements  in  the  computa¬ 
tional  space  are  the  same  size,  Fig.  1.7. 

This  circular  case  also  offers  many  advantages  for  simulation,  such  as  its 
simplicity:  it  is  easy  to  find  equations  for  the  circles  in  the  pixel  fitted 
simulation,  and  the  actual  structure  is  much  more  like  that  of  the  eye  them 
the  rectangular  structure. 

Unfortunately,  along  with  these  advantages  are  also  some  serious  disad¬ 
vantages.  For  example,  a  relatively  large  area  of  the  sensor  is  not  covered 
by  elements;  complete  coverage  can  only  be  accomplished  if  neighboring  ele¬ 
ments  can  be  overlapped.  In  an  actual  solid  state  device  this  overlap  is 
impossible,  so  this  would  be  a  problem  for  sensor  implementation.  In  addi¬ 
tion  to  this,  the  lines  separating  elements  are  no  longer  straight  from  the 
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center  to  the  periphery,  which  could  make  line  routing  more  difficult.  Since 
the  image  plane  maps  to  a  circular/columnar  structure,  the  computational 
plane  is  neither  a  rectangular  grid,  nor  a  hexagonal  one.  This  means  that 
existing  image  processing  techniques  no  longer  apply  to  the  computational 
plane.  The  rectangular  array,  which  is  an  eight  neighborhood,  is  now 
replaced  by  the  staggered  circular  array,  which  is  a  special  case  of  the  six 
neighborhood.  Even  though  this  structure  forces  us  to  develop  new  process¬ 
ing  techniques,  the  use  of  a  six  neighborhood  could  significantly  decrease  pro¬ 
cessing  time  due  to  the  smaller  number  of  operations,  as  indicated  before. 
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The  final  major  disadvantage  of  the  circular  structure  is  that  the 
number  of  elements  in  each  ring  determines  the  inter-ring  spacing.  The  cir¬ 
cular  elements  fit  together  in  such  a  way  that  when  the  number  of  elements 
in  a  ring  is  specified,  the  exponential  spacing  between  the  rings  is  set.  This 
means  that  outside  of  the  specification  of  the  number  of  elements  in  each 
ring,  there  is  no  control  over  the  resolution.  It  also  means  that  when  a 
small  number  of  elements  is  used,  the  spacing  between  the  rings  increases, 
which  could  lead  to  problems  due  to  the  vast  differences  in  area  between 
inner  and  outer  elements. 

The  geometry  of  the  circular  element  arrangement  was  analyzed  in  depth 
to  determine  just  how  the  number  of  elements  in  each  ring  is  related  to  the 
size  of  the  elements  and  to  the  inter-ring  spacing.  This  was  done  by  study¬ 
ing  the  geometric  relations  between  adjacent  elements.  By  constructing 
several  triangles  with  vertices  at  the  center  of  adjacent  circles,  a  mathemati¬ 
cal  relationship  between  the  elements  can  be  determined,  Fig.  1.8.  In  this 
case,  N  is  the  specified  number  of  elements  per  ring,  and  the  following  rela¬ 
tions  hold. 
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(16) 
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By  normalizing  (the  sizes  will  later  be  scaled  to  fit  the  rectangular 
array)  to  1,  R2  follows  immediately  from  (9),  and  rx  and  r2  are  simi¬ 
larly  simple  to  find. 

r  1=sin(7r/iV  )  (17) 

r2=i?2sin(7r/W)  (18) 

From  this  particular  case  it  is  quite  easy  to  find  the  general  relationship 
for  the  n,h  ring. 

Rn=R2n  (19) 

rn=R2nsin(ir/N)  (20) 

From  equations  (15)  through  (20)  we  obtain  all  of  the  information 
necessary  to  produce  the  circular  simulation  in  the  image  plane.  The  map¬ 
ping  into  the  computational  plane  is  actually  quite  simple  to  simulate,  being 
based  on  a  relatively  uncomplicated  geometry,  Fig.  1.9. 

The  equations  to  fit  this  mapping  onto  a  rectangular  array  are  also 
straightforward.  In  the  equations  below,  n  is  the  specified  number  of  ele¬ 
ments  per  ring  and  m  is  the  number  of  rings. 

dh=2r  +(m— l)r!  (21) 

r  i= V  (2r  )2— r  2"=  V  4r2— r2=  \Fir  (22) 

df,=2r  +(m— O^r  =2+v/3(m  — l)r  (23) 

dv  =n(2r  )+r  =(2n  +l)r  (24) 

Now  the  computational  plane  situation  is  just  a  matter  of  solving  equa¬ 
tions  (23)  and  (24)  for  the  r  that  best  fits  the  computational  plane  informa¬ 
tion  to  an  array  for  display.  This  step  is  unnecessary  in  reality,  because 
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only  the  information  Is  important  in  the  actual  sensor.  This  completes  the 
necessary  equations  for  the  circular  simulations. 

The  hexagonal  element  case  is  very  similar  to  the  circular  elements  in 
that  it  is  essentially  just  an  expansion  of  each  circular  element  until  total 
coverage  is  obtained.  That  is,  if  each  circular  element  is  made  larger  so  that 
all  of  the  sensor  area  is  covered,  the  intersections  of  the  elements  form,  very 
nearly,  hexagons.  While  these  hexagons  are  close  to  being  regular  (all  sides 
and  angles  equal),  they  are  slightly  "warped"  due  to  the  structure  of  the 
sensor.  The  basic  structure  is  that  of  concentric  rings  of  increasing  radius, 
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each  with  the  same  number  of  hexagonal  elements,  with  each  subsequent  ring 
staggered  from  its  two  nearest  neighbors.  This  maps  into  the  computational 
plane  as  columns  of  hexagonal  elements,  with  each  column  staggered  from  its 
two  nearest  neighbors,  Fig.  1.10.  This  design  also  has  advantages  and  disad¬ 
vantages,  which  will  be  discussed  below. 

One  of  the  major  advantages  is,  precisely,  that  all  of  the  sensor  area  is 
covered  by  elements,  and  the  log  spiral  structure  is  maintained.  This  is 
basically  a  combination  of  the  good  aspects  of  the  other  two  designs,  but 
there  are  also  bad  aspects  of  this  structure. 


Figure  1. 10.  Image  and  Computational  Planes  for  Hexagonal  Elements. 
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Most  of  the  disadvantages  of  this  arrangement  are  the  same  as  those  for 
the  circular  element  case,  such  as  the  inability  to  control  inter-ring  spacing, 
and  the  lack  of  straight  lines  from  the  center  to  the  periphery.  In  addition 
to  these  problems,  the  hexagons  are  by  far  the  hardest  to  simulate  (this  is  a 
secondary  problem  with  little  relevance  to  the  implementation).  The  rec¬ 
tangular  elements  are  defined  by  two  circles  and  two  lines  through  the  center 
of  the  array,  which  is  a  fairly  simple  structure  to  specify.  The  circular 
elements  are  even  easier  to  define,  by  using  only  one  circle  for  each.  The 
hexagons,  on  the  other  hand,  are  composed  of  six  lines,  only  two  of  which 
go  through  the  center  of  the  array.  This  geometry,  which  eliminates 
uncovered  sensor  area,  also  complicates  simulation. 

Since  we  know  that  these  hexagons  must  be  "warped"  slightly  to  prop¬ 
erly  fit  the  structure,  it  is  necessary  to  determine  just  how  this  occurs.  To 
define  the  geometry  of  the  sensor,  the  preservation  of  the  angles  of  the  hexa¬ 
gons  (see  Fig.  1.11.)  was  first  investigated.  By  drawing  a  model  of  one  ele¬ 
ment  of  the  array,  equations  can  be  derived  to  express  the  changes  in  the 
angles  as  a  function  of  the  number  of  elements  per  ring. 


a=T t/N 

(25) 

aj+2a4=27r 

(26) 

ai2+2ai3=27r 

(27) 

a3+a=a4 

(28) 

Unfortunately,  since  N  is  the  given  number  of  elements  per  ring,  there 
are  not  enough  equations  to  solve  this  problem  for  all  of  the  angles.  To  get 
around  this,  the  condition  that  opposite  angles  must  add  to  240  degrees  was 
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Imposed  (which  preserves  as  much  of  the  regular  hexagon’s  features  as  possi¬ 
ble).  This  gives  two  more  equations  so  that  the  system  may  be  solved. 


ai+a2=4ir/3 


(29) 


at3+a4=4ir/3  (30) 

Substitution  yields  the  following  relationships,  which  fully  characterize 
the  tingles  in  the  hexagonal  case. 

a3=(47r/3-7r/tf)/2  (31) 

a4=47r/3— a3  (32) 

a1=27r— 2a4  (33) 

a2=2n—2ai  (34) 

Now  that  the  angles  are  specified,  the  relationships  between  the  sides  can 
be  explored.  This  is  accomplished  by  creating  two  elements  and  making 
some  simple  observations  about  the  geometry.  Fig.  1.12.  The  rest,  even 
though  fairly  involved,  is  just  simple  algebra. 
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a  =(r  i~ x  2/2)sin(a) 


a  =x  isin(a2/2) 


From  (37)  and  (38), 


x  i=(r  3— x2/2)-t 


sin(a) 


sin(az/2) 


b  =(r  j+x  2/2)sin(a) 
6=x3sin(ax/2) 


From  (40)  and  (41), 


*3=(ri+x2/2) 


sin(a) 

sin(ax/2) 


fyy. 


K  = 


sin(cK2/2)sin(a1/2 ) 


sin2(a) 


+1/4 


(44) 


From  equations  (43)  and  (44),  several  more  relationships  can  be  deter¬ 


mined  by  substitution  into  (39)  and  (42)  shown  previously. 


AT1=(1— 1/2AT) 


sin(a) 


(45) 

(46) 

(47) 

sinCa^/2)  (48) 

By  making  a  similar  comparison  with  the  larger  hexagon,  and  from  (35), 

(39),  and  (42), 


sin(a2/2) 
x3=K2ri 

sin(a) 


K2=(l+V2K)-i 


y1=jc3=(ri+x2/2> 


sin(a) 

sinCaj/2) 


=(r2— y2/2) 


sin(a) 

sin(a2/2) 


From  (43), 


(49) 


y2=r2/K 

From  (43),  (49),  and  (50), 

^(1+1/2*)  _r2(l—l/2A~) 
sin(ai/2)  sin(o2/2) 

Which  reduces  to 


(50) 


(51) 


r2  _  (1+1/2 A"  )sin(a2/2) 

77“  (1 — -1/2JST )sin(a1/2)  t52') 

Now,  since  K  is  completely  specified  (a  is  a  function  of  N  and  aj  and 
a2  are  determined  by  the  previously  described  method),  the  inter-ring  spacing 
constant  is  found  by  normalizing  rt  to  1.  The  general  case  now  follows. 


r.=r0(— )" 


(53) 


-27- 


Where  r0  is  the  smallest  radius. 

Using  (43)  through  (53)  provides  the  lengths  for  all  of  the  sides.  This 
completely  specifies  all  of  the  geometric  information  for  the  hexagonal  ele¬ 
ment  case. 

Using  the  mathematical  relationships  deduced  above,  the  simulations  can 
now  be  performed. 

1.4.  Simulations 

Based  on  the  equations  of  Sect.  1.3,  Computer  Elided  design  and  simula¬ 
tion  were  performed.  Two  types  of  computer  models  were  developed,  the 
image  and  computational  plane  design  or  structural  design,  and  the  pixel 
fitting  or  perceptual  simulation.  In  the  structural  design,  a  plotting  package 
was  used  to  draw  the  actual  arrangement  of  the  elements  according  to 
parameters  determined  beforehand.  In  the  perceptual  simulation,  a  regular 
square  array  camera  was  used  to  take  images,  which  were  then  used  to  pro¬ 
duce  pictures  simulating  the  appearance  of  that  image  in  the  image  and  com¬ 
putational  planes  of  the  BVS  sensor. 

The  structural  designs  were  fairly  straightforward,  once  the  geometry 
discussed  in  the  preceeding  section  was  worked  out.  They  essentially  con¬ 
sisted  of  using  the  equations  found  and  drawing  the  boundaries  of  the  ele¬ 
ments  in  both  the  image  and  computational  planes. 

The  rectangular  case  was  first  explored  by  writing  a  program  to,  from 
set  parameters,  calculate  all  of  the  necessary  equations  and  create  a  file  that 
is  readable  by  the  plotter  package.  This  program  creates  both  the  image  and 
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computational  plane  structures.  The  program  is  shown  in  Appendix  A,  and 
the  type  of  structure  obtained  can  be  seen  in  Appendix  B,  Figures  B1  and  B2 
(image  and  computational  planes  respectively),  or  in  the  text  as  Figures  1.5. 
and  1.6. 

The  circular  case  was  designed  in  a  similar  fashion,  except  that  it  was 
necessary  to  create  a  root  finding  subroutine  to  solve  the  inter-ring  spacing 
equation.  Once  this  is  done,  the  program  calculates  all  of  the  proper  radii 
find  creates  the  image  and  computational  plane  plot  files.  This  program  is 
also  in  Appendix  A  and  examples  of  these  designs  are  found  as  Figure  1.7. 
in  the  text  and  in  Appendix  B,  Figures  B3  and  B4  (again  image  and  compu¬ 
tational  planes). 

The  most  difficult  of  the  three  structural  simulations  was  the  hexagonal 
element  case.  The  difficulty  was  due  to  the  number  of  lines  used  to  specify 
each  hexagon.  The  program  calculates  all  of  the  locations  for  the  vertices 
from  given  information,  then  creates  the  files  to  be  plotted.  The  program 
and  examples  are  located,  as  in  the  other  two  cases,  in  Appendix  A  and 
Appendix  B,  Figures  B5  and  B6,  respectively,  as  well  as  in  the  text  as  Fig¬ 
ure  1. 10. 

All  of  these  simulations  produced  good  results,  and  the  logarithmic 
structure  can  be  seen  easily  in  the  circular  and  hexagonal  cases.  It  is  also 
apparent  that  the  difference  in  size  between  inner  and  outer  elements  in  the 
circular  and  hexagonal  situations  could  be  a  problem  for  implementation. 
The  number  of  elements  used  in  all  cases  is  small,  but  should  prove  to  be 
sufficient  in  some  applications.  The  actual  number  of  elements  will  depend, 
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of  course,  on  the  required  resolution. 

The  second  type  of  simulation,  the  perceptual  simulation,  was  done  using 
the  EE  Department  image  processing  equipment  to  mimic  the  appearance  of 
images  in  the  image  and  computational  planes.  Images  were  created  using  a 
512x512  CCD  camera  and  support  equipment.  The  programs  read  in  these 
images,  then,  according  to  the  calculated  geometry,  pixel-fits  the  image  to  the 
new  structure. 

The  process  works  as  follows:  the  geometry  of  each  element  is  specified 
(location  and  boundary),  then  the  image  is  examined  until  all  of  the  pixels 
of  that  image  that  are  inside  the  specified  boundary  are  found,  then  these 
pixels’  intensity  values  are  averaged!  and  all  of  the  area  covered  by  these 
pixels  is  set  to  the  average  value.  This  is  done  for  each  element,  and  the 
information  is  saved  to  be  mapped  into  the  computational  plane. 

The  computational  plane  processing  is  done  similarly,  with  the  element 
first  being  located  and  its  boundary  found.  Then  the  value  of  the  element 
from  the  image  plane  that  corresponds  to  this  computational  plane  element  is 
used  as  the  value  for  all  of  the  pixels  inside  the  boundary.  This  process  is 
repeated  for  each  element  until  the  mapping  is  complete.  This  simulation 
could  become  much  more  complicated  if  hardware  preprocessing  is  inserted 
between  the  image  and  computational  planes. 

The  programs  then  write  out  both  the  image  plane  image  and  the  com¬ 
putational  plane  image  in  a  form  suitable  for  display. 


t  This  is  done  in  order  to  get  an  equivalent  average  intensity  for  the  element. 
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The  four  original  images  are  shown  in  Fig.  1.13. 

The  rectangular  element  case  was  the  simplest  to  simulate,  and  the 
results  are  very  encouraging.  The  resolution  in  the  image  plane  is  good,  as 
shown  in  Figs.  1.14(a)  to  1.14(d)  even  though  there  is  a  relatively  small 
number  of  elements  being  used.  Results  show  that  usable  information  can 
be  obtained  from  a  small  number  of  elements  with  a  drastic  savings  in  total 
data  to  be  processed  (3840  elements  are  used  in  Fig.  1.14.).  The  computa¬ 
tional  plane  situation  gives  us  almost  exactly  what  we  expect  from  theory, 
and  the  mapping  does  have  the  important  form  invariance  characteristics 
(Form  invariance  under  magnification  is  shown  in  Fig.  1.14(a),  and  form 
invariance  under  rotation  is  shown  as  Fig.  1.14(b).).  The  distortion  due  to 
shifting  was  also  quite  evident,  Fig.  1.14(c). 

Is  is  also  evident  that  the  ability  to  control  the  inter-ring  spacing  is  a 
definite  advantage.  A  great  increase  in  resolution  was  obtained  just  by 
decreasing  the  inter-ring  spacing.  This  made  the  size  change  between  rings 
smaller,  and  allowed  more  elements  to  be  used;  hence,  better  resolution. 
Unfortunately,  this  cannot  be  done  directly  in  the  other  two  cases. 

The  rectangular  and  circular  simulation  programs  are  shown  in  Appendix 
A. 

The  circular  simulation  was  also  performed  with  favorable  results.  The 
image  and  computational  planes  give  images  that  are  almost  completely  as 
expected.  The  image  plane  simulation  clearly  shows  where  the  sensor  is  not 
covered  by  elements,  and  the  nonrectangular  computational  plane  arrangement 
is  also  evident,  Figs.  1.15(a)  to  1.15(d).  Again,  form  invariance  under 


Figure  1.14(a).  Rectangular  Element  Simulation  of  (1)  in  Fig.  1.13 
Demonstrates  Form  Invariance  Under  Magnification. 


Figure  1.14(b).  Rectangular  Element  Simulation  of  (2)  in  Fig.  1.13. 
Demonstrates  Form  Invariance  Under  Rotation. 


Figure  1.14(d).  Rectangular  Element  Simulation  of  (4)  in  Fig.  1.13. 
Demonstrates  Resolution  of  Simulation. 
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magnification  and  rotation  are  demonstrated,  Figs.  1.15(a)  and  1.15(b)  respec¬ 
tively,  and  the  shift  induced  distortion  is  fairly  obvious,  Fig.  1.15(c). 

It  is  also  easy  to  see  that  the  inability  to  directly  change  the  inter-ring 
spacing  may  limit  the  flexibility  of  this  arrangement.  Even  though  this  spac¬ 
ing  cannot  be  controlled,  the  resolution  is  still  quite  good,  in  both  planes, 
Fig.  1.15(d). 

The  hexagonal  structure  simulation  was  not  finished  to  be  included  in 
this  report. 

L5.  Verification  of  Properties 

This  section  is  concerned  with  the  verification  of  the  form  invariance 
under  magnification  and  rotation  properties  of  the  complex  logarithmic  spiral 
conformal  mapping  (LSM),  for  both  the  rectangular  and  circular  element 
simulations. 

The  rectangular  simulation  did  indeed  demonstrate  the  property  of  form 
invariance  under  magnification.  This  is  shown  in  Fig.  1.14(a).  In  the  case 
shown,  two  squares  are  shown  one  inside  the  other— this  Is  the  same  as  a 
magnification  of  a  square  (the  "squares"  appear  as  rectangles  due  to  the  dis¬ 
tortion  caused  by  the  camera’s  rectangular  elements).  The  mapping  gives  us 
exactly  the  same  shape  for  both  of  the  squares,  verifying  the  property  indi¬ 
cated  by  theory. 

The  circular  simulation  provides  similar  verification  of  this  property 
when  the  same  original  image  is  used.  This  is  shown  in  Fig.  1.15(a).  As  in 
the  rectangular  case,  the  mapping  gives  the  same  edge  for  both  cases,  with 
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magnification  and  rotation  are  demonstrated,  Figs.  1.15(a)  and  1.15(b)  respec¬ 
tively,  and  the  shift  induced  distortion  is  fairly  obvious,  Fig.  1.15(c). 

It  is  also  easy  to  see  that  the  inability  to  directly  change  the  inter-ring 
spacing  may  limit  the  flexibility  of  this  arrangement.  Even  though  this  spac¬ 
ing  cannot  be  controlled,  the  resolution  is  still  quite  good,  in  both  planes, 
Fig.  1.15(d). 

The  hexagonal  structure  simulation  was  not  finished  to  be  included  in 
this  report. 

1.5.  Verification  of  Properties 

This  section  is  concerned  with  the  verification  of  the  form  invariance 
under  magnification  and  rotation  properties  of  the  complex  logarithmic  spiral 
conformal  mapping  (LSM),  for  both  the  rectangular  and  circular  element 
simulations. 

The  rectangular  simulation  did  indeed  demonstrate  the  property  of  form 
invariance  under  magnification.  This  is  shown  in  Fig.  1.14(a).  In  the  case 
shown,  two  squares  are  shown  one  inside  the  other— this  is  the  same  as  a 
magnification  of  a  square  (the  "squares"  appear  as  rectangles  due  to  the  dis¬ 
tortion  caused  by  the  camera’s  rectangular  elements).  The  mapping  gives  us 
exactly  the  same  shape  for  both  of  the  squares,  verifying  the  property  indi¬ 
cated  by  theory. 


The  circular  simulation  provides  similar  verification  of  this  property 
when  the  same  original  image  is  used.  This  is  shown  in  Fig.  1.15(a).  As  in 
the  rectangular  case,  the  mapping  gives  the  same  edge  for  both  cases,  with 


Figure  1.15(a).  Circular  Element  Simulation  of  (1)  in  Fig.  1.13. 
Demonstrates  Form  Invariance  Under  Magnification. 


Figure  1.15(c).  Circular  Element  Simulation  of  (3)  in  Fig.  1.13. 
Demonstrates  Distortion  Due  to  Shifting. 


a  shifting  in  the  x  direction  only,  providing  further  proof  of  the  validity  of 
the  form  invariance  under  magnification. 

The  rectangular  simulation  was  performed  on  the  rotated  (and  magnified) 
superimposed  squares  in  an  effort  to  verify  the  form  invariance  under  rota¬ 
tion.  This  simulation  did  demonstrate  that  the  theory  was  correct  and  that 
the  shape  in  the  computational  plane  under  the  mapping  is  the  same  for  both 
of  the  rotated  squares.  This  is  shown  in  Fig.  1.14(b). 

Similar  results  were  obtained  using  the  circular  simulation  on  the  same 
original  image.  Again  the  property  was  verified  and  the  demonstration 
appears  in  Fig.  1.15(b).  The  shape  is  shifted  only  in  the  y  direction,  but  is 
identical  to  the  nonrotated  shape. 

Information  is  lost  due  to  the  nonoverlapping  nature  of  the  circular 
simulation.  Since  the  elements  are  circular,  they  cannot  cover  all  of  the 
area  when  placed  in  this  structure,  so  some  of  the  information  is  lost. 

This  is  shown  in  Figs.  B3  and  B4  in  appendix  B  and  Figs.  1.16  and 
1.17.  The  space  that  is  not  covered  is  clearly  visible  in  all  cases,  thus  this 
particular  aspect  of  the  theory  is  also  obtained  in  the  simulation. 

1.6.  Comparison  to  the  Conventional  Sensor 

This  section  deals  with  the  direct  comparison  of  the  simulations  to  the 
conventional  sensor  (i.e.  a  rectangular  array  comprised  of  rectangular  pixels) 
for  both  the  rectangular  and  circular  element  cases.  The  three  areas  of  com¬ 
parison  are  resolution,  number  of  elements,  and  field  of  view.  We  would 
expect  to  have  comparable  resolution  near  the  fovea  in  our  design,  a  great 


Figure  1.16.  Computational  Plane  of  Circular  Element  Simulation. 
Demonstrates  Uncovered  Sensor  Area. 
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savings  in  the  number  of  elements,  and  a  greatly  increased  field  of  view. 


1.6.1.  Resolution 


The  comparison  of  resolution  in  our  current  simulations  was  performed 
geometrically,  based  on  the  actual  number  of  elements  used.  The  drastic 
savings  was  evident  in  both  the  rectangular  and  circular  cases,  with  both 
the  fovea  blank  and  with  the  fovea  filled  with  normal  rectangular  elements. 
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The  current  rectangular  simulation  uses  64  elements  per  ring  for  60 
rings,  or  a  total  of  3840  elements.  The  area  of  the  smallest  rectangular  ele¬ 
ment  is  roughly  2.36  pixels,  so  the  resolution  at  the  fovea  is  about  half 
that  of  the  normal  sensor.  This  calculation  is  very  rough  and  should  be 
repeated  with  better  precision  (the  biggest  error  comes  from  the  assumption 
that  the  pixels  are  square,  instead  of  their  actual  rectangular  shape).  Still, 
this  resolution  is  equivalent  to  that  of  a  362x362  array,  which  is  quite 
good  in  many  applications. 

The  current  circular  simulation  uses  64  elements  per  ring  in  35  rings, 
for  a  total  of  2240  elements.  The  smallest  element’s  area  is  about  1.35  pix¬ 
els  (again  this  is  a  rough  calculation),  which  makes  our  resolution  fr  irly 
comparable  to  the  normal  array  of  512x512  pixels.  This  resolution  near  the 
fovea  is  very  good  and  useful  in  many  situations. 

The  real  drastic  differences  should  come  in  when  these  resolutions  are 
observed  in  light  of  the  greatly  decreased  number  of  elements. 

1.6.2.  Number  of  Elements 

The  number  of  elements  in  our  array  was  compared  to  that  of  the  nor¬ 
mal  sensor  for  the  rectangular  and  circular  simulations  under  two  conditions: 
without  fovea  filling  and  with  fovea  filling.  This  experiment  should  give  us 
an  idea  of  the  savings  that  this  sensor  may  provide. 

The  rectangular  element  case,  at  64x60,  gave  us  3840  elements.  Com¬ 
paring  to  our  512x512  array,  we  are  now  using  only  1.46%  the  number  of 
elements  that  are  used  in  the  normal  sensor,  which  gives  us  an  amazing 
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computational  savings.  If  the  fovea  is  included,  we  now  have  5700  ele¬ 
ments  total,  which  is  only  2.17%  of  the  normal  sensor  elements— again  a 
major  savings.  j 

This  was  based  on  a  512x512  array,  but  we  have  shown  that  our  reso¬ 
lution  is  only  half  that  of  the  512x512  array.  If  we  compare  to  the 
362x362  array  that  has  roughly  the  same  resolution  as  ours,  we  still  have  I 

only  2.72%  with  no  fovea  and  4.34%  with  the  fovea.  This  means  that  even 
at  a  comparable  resolution  the  computational  savings  are  enormous. 

In  the  circular  element  case,  at  64x35,  we  have  2240  elements  and 
about  512x512  resolution  near  the  fovea.  So  the  direct  comparison  to  the 
normal  sensor  means  that  we  are  using  only  0.85%  of  the  total  number  of 
elements  in  the  normal  case!  Even  if  we  populate  the  fovea  this  gives  us 
only  2702  elements  or  1.03%.  This  clearly  demonstrates  that  the  near  fovea 
resolution  is  more  them  justified  by  the  huge  computational  savings,  even  if 
the  other  properties  can  never  be  used. 

1.6.3.  Field  of  View 

This  section  compares  the  field  of  view  of  our  sensor  to  that  of  a  rec¬ 
tangular  sensor  with  the  same  number  of  elements.  It  covers  the  cases  of 
rectangular  elements,  circular  elements,  fovea  open,  fovea  covered,  direct 
comparison  and  "normalized"  comparison.  Since  our  array  is  circular  and  the 
comparison  is  made  using  a  square  array  of  square  pixels,  there  are  three 
different  field  of  view  measurements—  Minimum  (minimum  distance  to 
square  boundary),  Maximum  (maximum  distance  to  square  boundary)  and 


Average  (average  distance  to  square  boundary). 

In  the  rectangular  case  without  fovea  and  making  a  direct  comparison, 
a  normal  sensor  with  3840  elements  would  have  a  field  of  view  of  only 
14.8%  (ave.  min.- 12.1%,  max.- 17.2%)  of  the  field  of  view  (FOV)  of  our  sen¬ 
sor.  If  our  fovea  is  populated,  giving  5700  elements,  a  normal  array  with 
5700  elements  has  a  FOV  of  only  18.0%  (ave.  min.=14.8%,  max.=20.7%)  of 
our  FOV.  This  shows  that  even  though  we  are  using  a  vastly  smaller 
number  of  elements  and  our  near  foveal  resolution  is  pretty  good,  we  still 
have  a  much  greater  field  of  view  them  a  normal  sensor  with  a  similar 
number  of  elements.  These  calculations  are  based  on  a  512x512  array,  but 
we  have  shown  our  resolution  to  be  less  than  that,  so  we  can  "normalize" 
this  to  the  actual  case. 

The  normalized  case  uses  a  square  array  of  square  elements,  each  with 
area  equal  to  the  area  of  the  smallest  rectangular  element  in  our  sensor. 
This  "normalizes"  the  FOV  calculations.  Without  the  fovea  in  the  rectangular 
element  case,  a  normal  FOV  for  the  "normalized"  case  would  be  20.9%  (ave. 
min.- 17.1%,  max.-24.3%)  of  our  FOV.  With  the  fovea  it  becomes  25.5% 
(ave.  min.-20.8%,  max.-29.3%)  of  our  FOV.  So  even  after  normalization 
our  sensor  still  has  a  much  better  FOV  than  a  comparable  normal  sensor. 

Since  the  circular  elements  have  area  roughly  that  of  the  512x512  case, 
we  do  not  need  to  normalize  to  get  an  idea  of  the  FOV  for  these  situations. 
A  square  array  of  2240  pixels  (no  fovea)  has  a  FOV  of  11.3%  (ave. 
min-9.4%,  max.-13.3%)  of  our  sensor’s  FOV.  With  the  fovea  filled  (2702 
elements),  a  normal  sensor  has  only  12.5%  (ave.  min-10.2%,  max.- 14.5%) 


the  FOV  that  our  sensor  provides.  So  again  our  sensor  has  a  drastically 
greater  FOV  than  a  normal  sensor  with  the  same  number  of  elements  (with 
area  the  same  as  the  smallest  element  in  our  array). 

1.7.  Conclusions 

The  results  to  date  indicate  that  this  new  sensor  design  will  provide 
benefits  over  current  image  detection  devices.  The  simulations  demonstrate 
the  properties  that  were  theorized,  and  the  proposed  savings  appears  to  be 
evident.  The  savings  in  the  number  of  elements  is  a  dramatic  testimony  of 
the  kind  of  computational  advantage  that  we  may  hope  to  achieve.  The 
resolution  of  this  sensor  is  another  favorable  indication  of  the  possible 
advantages  of  this  configuration.  The  improvement  in  field  of  view  is  an 
area  that  also  justifies  the  possible  use  of  this  sensor. 

A  large  quantity  of  basic  research  remains  to  be  completed,  including 
the  hexagonal  simulation.  Once  the  simulations  are  complete,  they  can  be 
used  for  a  variety  of  tests  to  determine  if  the  benefits  of  this  sensor  are 
worthwhile  enough  to  explore  further. 
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CHAPTER  n 

MODELLING  EDGE  DETECTION  IN  THE  HUMAN  VISUAL  SYSTEM 
AND  USING  THE  NEW  SENSOR 


Introduction 

The  aim  of  this  chapter  is  to  present  two  different  simulations  of  edge 
detection,  one  for  the  human  peripheral  visual  system,  by  giving  a  functional 
interpretation  of  the  retina  and  the  lateral  geniculate  nucleus,  the  other  for 
the  new  sensor. 

The  simulation  of  edge  detection  for  the  human  peripheral  visual  system 
will  emulate  the  functions  of  the  retinal  ganglion  cells  and  lateral  geniculate 
nucleus  which  perform  preprocessing  between  the  retina  and  the  striate  cor¬ 
tex.  After  this  preprocessing,  the  result  is  mapped  to  the  striate  cortex  (or 
computation  plane).  The  preprocessing  of  the  two  -  dimensional  brightness 
distribution  available  at  the  retina,  by  the  complex  logarithmic  retinotopic 
mapping,  may  possibly  play  a  role  in  the  form  invariance  property  of  the 
image  plane  -  computation  plane  mapping  [1,2]. 

The  simulation  of  edge  detection  for  the  new  sensor  assumes  a  direct 
mapping  (i.e.  a  simple  projection)  of  the  image  from  the  retina  (image  plane) 
into  the  striate  cortex  (computation  plane)  without  any  intermediate  process¬ 
ing.  Thus,  the  edge  detection  is  implemented  directly  in  the  computation 
plane  (striate  cortex).  Although  this  is  not  exactly  the  processing  which  the 


human  peripheral  visual  system  performs,  it  preserves  the  most  important 
characteristic  -  ’form  invariance*.  Also,  it  is  very  convenient  for  further 
processing,  such  as  motion  detection,  using  image  processing  techniques. 

The  organization  of  this  chapter  is  as  follows:  In  Sect.  II.  1  an  analysis 
of  the  cells  and  the  structure  of  the  peripheral  visual  system  is  presented.  In 
Sect.  H.2  a  simple  experiment  on  the  peripheral  visual  system  and  some  of 
its  properties  are  discussed.  The  mathematical  formalization  and  some  simula¬ 
tion  examples  are  presented  for  the  human  peripheral  visual  system  in  Sect. 
II.3.  In  Sect.  II.4  the  simulation  for  the  new  sensor  is  presented.  In  Sect. 
II.5  savings  in  computations  for  the  new  sensor  compared  to  rectangular  sen¬ 
sor  is  discussed.  In  the  last  section,  the  objectives  of  our  work  are  discussed 
and  the  two  different  simulations  are  compared. 

II.  1.  Properties  of  the  Peripheral  Visual  System 

In  this  section,  some  properties  of  the  peripheral  stages  of  the  human 
visual  system  (HVS),  i.e.  the  retinal  ganglion  cells  and  the  lateral  geniculate 
nucleus,  are  reviewed.  Fig.  II.  1(a)  represents  the  HVS.  The  relationship  of 
the  peripheral  visual  system  with  the  retina  and  the  visual  cortex  is  shown 
in  Fig.  H.l(b). 

II.1.1.  Retinal  Ganglion  Cells 

The  image  perceived  by  the  cones  and  rods  in  the  retina  is  processed  by 
the  retinal  ganglion  cells.  In  the  vertebrate  retina  the  cell  bodies  of  the  neu¬ 
rons  are  arrayed  in  three  distinct  layers  [3].  The  outermost  layer  (the  one 
farther  from  the  lens  of  the  eye)  consists  of  the  receptor  cells.  The  next 
layer  includes  the  bipolar  cells  (which  conduct  messages  from  the  receptors 
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Fig.  II.  1(b).  Relationship  of  peripheral  visual  system  with  retina  and  visual 
cortex. 


to  the  cells  in  the  third  layer)  and  the  horizontal  and  amacrine  cells,  which 


appear  to  be  involved  in  the  lateral  transmission  of  information.  The  third 


layer  contains  the  ganglion  cells,  whose  axons  form  the  optic  nerve,  the  sole 
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output  of  the  retina.  Fig.  U.2  shows  the  different  neuron  layers  in  the  ver¬ 
tebrate  retina. 

A  given  retinal  ganglion  cell  receives  information  from  a  rather  small 
population  of  the  receptor  cells.  The  area  covered  by  these  receptors  is  called 
the  receptive  field  of  that  ganglion  cell.  The  receptive  field  of  a  ganglion  cell 
can  be  subdivided  into  two  classes,  one  characterized  by  an  ON  center  and 
cm  OFF  surround,  the  other  by  tin  OFF  center  and  an  ON  surround  [4]. 
Since  the  responses  of  these  different  parts  of  the  receptive  field  all  converge 
on  and  share  a  common  path  -  the  axon  of  the  ganglion  cell  -  it  is  evident 
that  the  intensity,  the  color,  and  the  spatial  and  temporal  configuration  of 
the  pattern  of  illumination  falling  on  receptive  field  may  all  be  significant 
factors  in  determining  the  ultimate  pattern  of  impulses  which  the  cell 
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Fig.  LT.2.  The  different  neuron  layers  in  the  vertebrate  retina  [19]. 
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discharges.  Combining  these  two  types  of  retinal  ganglion  cells  produces 
neural  responses  with  maximum  and  minimum  adjacent  to  the  points  that 
correspond  to  steps  in  the  pattern  of  illumination  (i.e,  marked  changes  in 
intensity). 

The  retinal  ganglion  cells  have  been  categorized  into  many  groups  based 
on  different  kinds  of  test.  Hochstein  and  Shapley  [5,6]  proposed  the 
classification  of  cells  as  X  or  Y  in  terms  of  the  linearity  or  nonlinearity  of 
their  spatial  summation.  From  their  basic  studies,  the  X-cells’  spatial  summa¬ 
tion  over  their  receptive  field  is  approximately  linear,  while  for  Y-cells  it  is 
nonlinear.  The  X-cells  respond  to  fine  pattern  and  slow  movement  [7].  The 
Y-cells  do  seem  to  be  involved  in  the  detection  of  coarse  pattern  and  fast 
movement  or  temporal  change  [5,6,7],  It  should  also  be  noticed  that  since 
Y-cells  have  a  resolution  limit  of  40%  of  X-cells,  it  is  extremely  unlikely 
that  they  will  signal  the  finest  gratings  in  humans.  However,  the  Y-cells  are 
more  numerous  them  the  X-cells  in  peripheral  fields. 

II.  1.2.  Lateral  Geniculate  Nucleus 

The  lateral  geniculate  nucleus  cells  exhibit  characteristics  similar  to  those 
of  the  retinal  ganglion  cells  [1].  The  basic  differences  are  :  a  considerable 
reduction  in  the  spontaneous  activity  of  X-cells  at  the  lateral  geniculate 
level,  and  an  increases  in  the  inhibition  exerted  by  the  surround  on  the 
center  response  of  X-cells.  Lateral  geniculate  cells  give  a  smaller  response  to 
diffuse  illumination  than  do  retinal  ganglion  cells,  sometimes  giving  no 
responses  at  all  [8]. 
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The  X-cells  of  the  retinal  ganglion  cells  project  to  the  lateral  geniculate 
only,  whereas  the  Y-cells  project  also  to  the  superior  colliculus  (where 
sensory-motor  integration  takes  place).  Thus,  combining  the  process  of  reti¬ 
nal  ganglion  cells  and  lateral  geniculate  nucleus,  the  X-cells  are  used  for  fine 
pattern  analysis  and  slow  motion  detection,  and  the  Y-cells  for  coarse  pattern 
analysis  and  fast  motion  detection. 

II.  1.3.  Distribution  and  shape  of  the  receptive  fields 

It  has  been  known  for  a  long  time  that  the  spatial  distribution  of  pho¬ 
toreceptors  is  nonuniform.  The  total  response  of  those  photoreceptors  compris¬ 
ing  a  receptive  field  is  sent  to  a  ganglion  cell.  Thus,  the  increase  in  ganglion 
cell  density  is  associated  with  an  increase  in  the  amount  of  visual  informa¬ 
tion  for  unit  visual  angle  transmitted  to  the  higher  level  of  visual  process¬ 
ing.  In  the  fovea  region,  the  visual  resolution  (almost  uniform)  is  very  high 
which  corresponds  to  more  dense  sampling  (or  higher  density  of  ganglion 
cells).  In  the  peripheral  field,  the  visual  resolution  decreases  with  eccentri¬ 
city1.  The  resulting  mapping  from  retina  to  striate  cortex  is  topologically  dis¬ 
torted,  so  the  higher  ganglion  cell  density  correspond  to  larger  areas  in  tbe 
striate  cortex.  This  kind  of  mapping  is  called  a  retinotopic  mapping. 

The  retinotopic  mapping  of  the  extrafoveal  visual  field  to  the  surface  of 
the  striate  cortex  is  characterized  as  a  logarithmic  conformal  mapping  [9]. 
The  cortical  magnification  factor  (the  distance  moved,  in  millimeters,  across 
the  cortical  surface  corresponding  to  one  degree  of  movement  of  a  point 
stimulus  in  the  visual  field)  is  radially  symmetric  and  very  close  to  an 

'Eccentricity  is  defined  as  the  distance  from  the  center  of  the  fovea  to  the  center  of  the  receptive 


field. 


inverse  linear  dependence  on  eccentricity  for  the  entire  peripheral  visual  held. 
For  the  central  fovea  region  (less  than  1  degree  of  eccentricity)  the  cortical 
magnification  factor  is  almost  a  constant,  and  it  is  assumed  that  the  inverse 
dependence  on  eccentricity  tapers  off  in  a  gradual  way.  Therefore,  the  size  of 
the  receptive  field  increases  with  eccentricity  whereas  the  density  of  ganglion 
cell  decreases  with  eccentricity.  The  cortical  magnification  factor  can  be 
expressed  by  the  following  equation  : 


k 

m  = — 
r 


(2.1) 


where  k  is  a  constant,  and  r  represents  eccentricity  from  the  fovea.  From 
this  equation,  a  relation  between  the  retina  and  striate  cortex  can  be  esta¬ 
blished  as  the  complex  logarithm  mathematical  formalism  : 


dw  _  1 
dz  z 


(2.2) 


w  =ln  (z  )  (2.3) 

where  dw  is  a  small  change  in  cortical  position,  and  dz  is  the  corresponding 
small  change  in  visual  field  position. 

The  magnification  factor  for  the  lateral-geniculate  nucleus  has  the  same 
form  as  that  for  the  striate  cortex.  Cell  density  in  both  the  lateral  geniculate 
nucleus  and  the  striate  cortex  is  roughly  constant  with  respect  to  eccentri¬ 
city.  Thus,  the  complex  logarithmic  structure  of  the  striate  cortex  seems  to 
be  effected  in  two  separate  steps:  1)  The  form  of  the  density  of  the  retinal 
ganglion  cells,  leading  to  a  logarithmic  "radial"  structure  in  the  optic  tract, 
and  the  lateral  geniculate  nucleus.  2)  The  projection  of  the  lateral  geniculate 
nucleus  onto  the  cortex,  where  an  angular  reorganization  of  optic  tract  fibers 
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is  effected  which  leads  to  the  final  form  of  the  striate  cortex  retinotopic  map 
as  in  the  equation  above. 

Concerning  the  function  of  the  retinal  ganglion  cell  and  the  lateral  geni¬ 
culate  nucleus  receptive  fields,  a  four  mechanism  model  for  edge  detection 
has  been  established  [10].  In  [10],  a  model  is  presented  for  edge  detection 
based  upon  probability  summation  among  mechanisms  with  an  excitatory 
center  and  an  inhibitory  surround.  These  mechanisms  increase  in  size  linearly 
with  eccentricity.  The  four  mechanisms  are  arbitrarily  named  N,  S,  T  and  U, 
the  properties  of  each  being  defined  by  the  difference  of  two  Gaussian  func¬ 
tions  (DOG): 


\vN(Rf)=AN(R') 


exp 


cr£CK  ) 
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Ai(R)=~-‘  -  ,  i  =N  .T  ,U 

l+Oj/C 

i 

cri(R)=<ri(l+kR)  .  i=NS,T,U 


In  these  equations  the  eccentricity  R  is  measured  in  degrees,  (gain  con¬ 
stant)  and  o-j  (space  constant)  are  the  values  at  the  fovea,  where  a;  and  k 
determine  the  rates  of  spatial  variation,  and  r  is  the  radius  of  the  receptive 
held.  Fig.  n.3  shows  the  profile  of  the  four  mechanism  at  zero  degrees 
(fovea)  and  at  an  eccentricity  of  4  degrees. 

N  and  S  mechanisms  are  relatively  sustained,  T  and  U  are  relatively 
transient  in  their  responses.  The  four  mechanisms  thus  seem  to  show  am 
appropriate  reciprocity  between  spatial  and  temporal  resolution  with  U  being 
widest  and  most  transient  and  N  being  narrowest  and  sustained. 

Physiologically,  the  N  and  S  mechanisms  represent  two  different  sizes  of 
X-type  cells,  with  the  T  and  U  mechanisms  corresponding  to  Y-type  cells. 


Distance  in  Degrees 


Width  of  Pulses  in  Degrees 


Fig.  n.3.  The  profiles  of  the  four  mechanisms  [10]. 


The  N  anti  S  mechanisms  could  be  classified  as  band-  pass,  while  T  and  U 
mechanisms  correspond  to  low-pass. 

In  general,  N  and  S  mechanisms  (sustained)  represent  X-type  cells  with 
smaller  receptive  fields  and  function  as  fine  edge  and  slow  motion  detection. 
T  and  U  (transient)  mechanisms  represent  Y-type  cells  with  a  larger  recep¬ 
tive  fields  and  function  as  coarse  edge  and  fast  movement  detection,  as  men¬ 
tioned  in  Sect.  H.1.2.  They  all  have  a  circularly  symmetrical  profile. 

Summarizing,  the  main  properties  of  the  receptive  fields  of  the  peripheral 
ganglion  cells  are  : 

(1)  The  size  of  the  receptive  field  increases  linearly  with  eccen¬ 
tricity  whereas  the  density  of  the  ganglion  cells  decreases 
linearly  with  eccentricity.  This  means  that  the  resolution 
decreases  with  eccentricity  or  the  sampling  grid  increases  with 
eccentricity. 

(2)  Overlapping  between  receptive  fields. 

(3)  The  receptive  field  has  a  circularly  symmetric  and  oscillating 
shape  in  which  the  center  and  the  surround  have  opposite 
signs. 

(4)  The  magnification  factor  is  radially  symmetric,  so  the  retino- 
topic  mapping  of  the  visual  field  to  the  surface  of  the  striate 
cortex  is  characterized  as  a  logarithmic  conformal  mapping. 
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IL2.  Experiment  on  Peripheral  Vision 

This  experiment  was  performed  to  establish  the  ability  of  human  peri¬ 
pheral  vision  for  moving  object  detection  and  shape  determination. 

The  subject  under  testing  was  instructed  to  keep  his  gaze  at  a  point 
marked  on  a  white  wall  in  front  of  him.  The  distance  subject- wall  was 
1.5m.  Trial  runs  were  made  with  every  subject  until  he  became  proficient  at 
keeping  his  sight  steady  on  the  dot.  The  2D  geometric  shapes  used  for  testing 
had  an  average  maximum  side  of  10cm.  For  example  the  hexagon  has  an 
8.5cm  side,  the  semicircle  had  a  diameter  of  10cm,  etc..  The  letters  used  for 
the  recognition  test  were  10cm  by  6cm.  The  number  of  subjects  tested  was 
five  with  an  average  age  of  25  years,  all  male,  and  each  test  was  performed 
twice  with  each  subject,  although  the  second  time  is  less  relevant  than  the 
first  because  the  subject  already  knew  what  shapes  to  expect.  Consequently, 
the  tables  below  indicate  the  average  for  the  five  subjects  using  the  first  run 
only.  The  angle  in  tests  1  and  2,  Tables  n.l  and  H.2,  is  measured  as  indi¬ 
cated  in  Fig.  11.4(a).  In  Table  II.  1,  notice  that  the  negative  angles  for  detec¬ 
tion  are  average.  Some  subjects  required  small  positive  tingles  for  detection. 
The  first  test  was  performed  with  the  sample  moving  horizontally,  i.e.  on 
the  XY  plane,  see  Fig.  11.4(a),  while  the  second  (Table  n.3)  was  performed 
with  the  sample  moving  vertically  along  the  XZ  plane,  Fig.  11.4(b).  The 
samples  were  attached  to  a  radial  spoke  rotating  on  a  shaft  located  above  the 
subject’s  head  and  mounted  on  a  frame.  The  velocity  of  the  sample  was, 
roughly,  2.6  degrees/second. 
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Fig.  11.4(a)  Measuring  angle  of  detection  for  sample  motion  on  the  XY  plane. 
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Fig.  11.4(b)  Measuring  angle  of  detection  for  sample  motion  on  the  XZ  plane. 


Table  II.  1,  The  Objects  Move  on  X-Y  Plane.  (Unit:  Degree) 


detecting  existence  of  the  object 

recognizing  the  shape 

triangle 

-3.2 

18.2 

circle 

-2.6 

19 

rhombus 

-2.5 

20.25 

square 

-6 

22.5 

moon  shape 

-5.4 

36.6 

ellipes 

-0.67 

41.33 

hexagon 

-4 

41.8 

semi-circle 

0 

46 

very  complicated  3-D  shape 

-6.75 

79.67 

Note: 

(1)  The  angle  for  detecting  existence  of  the  objects  varies  from  -12  to  8 
degrees. 

(2)  The  resolution  in  angle  is  1  degree,  and  data  in  the  table  are  average 
values. 


Table  II.2,  The  Letters  Move  on  X-Y  Plane.  (Unit:  Degree) 


letters 

A 

U 

P 

T 

O 

N 

C 

recognizing  the  letter 

26.5 

HIS 

36.4 

36.75 

38 

38 

38 

letters 

D 

E 

B 

F 

0 

G 

recognizing  the  letter 

40.75 

44 

44.5 

45.2 

50.8 

51 

Notes: 

(1)  Maximum  deviation  for  the  letter  recognition  is  24.5°. 


(2)  It’s  difficult  to  distinguish  between  letters  of  similar  shape. 


-64- 


Table  n.3,  The  Objects  Move  on  X-Z  plane.  (Unit:  degree) 


detecting  existence  of  the  object 

recognizing  the  shane 

difference 

triangle 

41 

47.25 

6.25 

square 

41.25 

50 

8.75 

moon-shape 

36 

52 

16 

circle 

38.5 

53.75 

15.25 

rhombus 

38 

54 

16 

semi-circle 

35.67 

58 

22.33 

hexagon 

38.75 

63.5 

24.75 

ellioes 

37 

66.33 

29.33 

II.2.1.  Results 

(1)  Peripheral  vision  is  very  sensitive  to  motion.  It  detects  the 
moving  object  in  far  eccentricity  very  fast. 

(2)  Peripheral  vision  extracts  blurred  or  coarse  edges  and  con¬ 
tours,  because  of  the  following  reasons  : 

(a)  The  sampling  distance  (spacing  between  centers  of 
adjacent  receptive  fields)  increases  with  eccentricity. 

(b)  As  the  radius  of  the  receptive  field  is  getting  larger 
with  eccentricity,  most  of  the  low  frequency  com¬ 
ponents  of  the  image  are  passed  by  the  processing  of 
the  peripheral  visual  system. 


(c)  Peripheral  vision  has  much  wider  detecting  range  in 
the  horizontal  direction  than  in  the  vertical  direction. 


H.3.  Simulation  of  Edge  Detection  in  the  Human  Visual  System 


Preprocessing  performed  by  the  peripheral  visual  system  (PVS)  includes: 
edge  detection  and  motion  detection  which  could  be  represented  by  the  block 
diagram  of  Fig.  n.5. 

IL3.1.  Scheme  of  the  geometric  distribution  of  the  receptive  fields  of  the  reti¬ 
nal  ganglion  cells  and  the  lateral  geniculate  nucleus 

According  to  the  main  properties  of  the  receptive  fields  of  the  peripheral 
visual  system,  the  scheme  of  the  geometric  distribution  of  the  receptive  fields 
of  the  retinal  ganglion  cells  and  the  lateral  geniculate  nucleus,  which  Braccini 
[1,11,12]  uses,  is  appropriate  for  simulation  but  with  different  organization. 
It  is  shown  in  Fig.  H.6.  The  geometric  centers  of  the  circles  represent  the 


Fig.  n.5.  Block  diagram  of  preprocessing  in  human  visual  system. 


J'm  kAk'l  mV  A 


sampling  points  and  form  a  triangular  lattice.  The  diameter  of  the  circles  is 
proportional  to  the  receptive  field  size.  Both  the  sampling  distance  and  the 
receptive  field  size  increase  linearly  with  eccentricity. 


above  equation  can  be  approximated  [13,14]  as  follows, 


(2.11) 


/>=0.92c(l+/fcic) 

where  R  is  the  eccentricity,  r  is  the  radius  of  the  receptive  field  and  k  is  a 
constant  factor  to  weight  the  influence  of  R,  [10].  The  exact  DOG  function 
(2.10)  and  approximated  function  (2.11)  produce  very  close  results,  see  Fig. 
H.7. 


1133  Convolution 

The  processing  performed  by  the  retinal  ganglion  cells  and  the  lateral 
geniculate  nucleus  can  be  approximated  by  the  convolution  of  the  input 
image  and  the  weighting  function  w(R,r): 

©O  7T 

g(.R,<f>)—J  J  w(R  j-)f  (Rcas<t)—rcosQj{sin<f>—rsinQ)rdrdQ  (2.12) 

0  — n 

where  f(R,<£)  is  the  input  image  which  is  formed  in  the  retina,  w(R,r)  is  the 
weighting  function  of  (2.11)  and  g(R,<£)  is  the  output  image,  R  and  r  have 
already  been  defined  and  <f>,  0  are  indicated  in  Fig.  11.9(a).  The  convolution 
output  g(R,<£)  for  constant  input  f(R,<£)-F  is  -2vFp2,if  the  above  weighting 
function  w(R,r)  is  used.  Because  the  convolution  is  not  zero  for  constant 
input,  it  is  difficult  to  extract  the  exact  edge  for  further  image  processing. 
It  is  desired  to  have  a  zerocrossing  to  unambiguously  indicate  the  presence  of 
an  edge  in  the  image.  To  avoid  this,  the  weighting  function  (2.11)  is 


modified  as  follows: 


DOG  function  from  (2.10) 


Fig.  II.7.  The  exact  and  the  approximated  DOG  functions. 


,  r’l 

-r2 

w  = 

exp 

2  P2 

(2.13) 


where  />=(l+fc.R  )cr;  (2.13)  has  the  same  form  as  the  Laplacian  of  Gaussian 
function  presented  bj  Marr  and  Hildreth  [8,16].  The  above  weighting  func¬ 
tion  is  space  variant  with  eccentricity  and  the  convolution  output  g(R,0)  is 


zero  for  constant  input  f(R,<£)=F. 


In  the  Gaussian  function  of  Marr  and  Hildreth, 


G(r)=ff2exp 


(2.14) 


c r  is  the  standard  deviation  for  a  given  spatial  location.  A  way  to  generalize 
this  function  to  give  a  spatially  variant  weighting  function  is  to  replace  c r 


by  (l+kR)cr  and  also  change  the  sign,  so 


W  V  G space  — variant  2  ~  exp  - 

P  V 


(2.15) 


where  p=(l+/k^)o-.  And  according  to  the  property  that  the  convolution  of 
the  Laplacian-of-the-Gaussian  function  with  the  input  is  equal  to  the  Lapla- 
cian  of  the  convolution  of  the  two  functions, 

gCR  •<f>)=V2Gspace-variWU  *f  (R  ,^)=V2  [g^^^  */  ( R  .</>)]  (2. 16) 

So,  whenever  an  intensity  change  occurs,  there  will  be  zero-  crossings  in 
those  intensity  changing  points.  Thus,  detecting  the  change  of  intensity  (edge) 
can  be  reduced  to  finding  the  zero  crossings,  see  Fig.  II.8. 


IL3.4.  Simulation  procedure  and  results 

According  to  the  scheme  of  the  geometric  distribution  of  the  receptive 
fields  which  is  shown  in  Fig.  II.6,  the  discrete  convolution  of  input  image 
and  the  weighting  function  of  the  receptive  field  is  applied  to  each  sampling 
point  for  edge  detection  simulation. 


«  •’«/«  ^ o  .*  *  -  *  •  ■  V* 


II.3.4.1.  Procedure 


(1)  Calculate  the  sampling  grid  (according  to  Fig.  II.6) 

Before  calculating  the  sampling  grid,  the  smallest  eccentricity  (the  radius 
of  the  fovea),  the  smallest  radius  of  the  central  region  of  the  overlapping 
receptive  field  and  the  overlapping  factor  must  be  given.  Then,  the  N,  S,  T 
and  U  mechanisms  could  be  simulated  by  giving  different  values  to  the 
smallest  radius  of  the  central  region  of  the  overlapping  receptive  fields. 


(a)  overlapping  factor  : 
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rM(=(l-o/)r0j 


(2.17) 


(2.18) 


where 


r0j  :  the  radius2  of  the  elements  In  ring#"  i  "  for  an  overlapping  recep¬ 


tive  field. 


rm>t  :  the  radius2  of  the  elements  in  ring  "  i  "  for  a  non-overlapping 


'>  ’  .  -  - 


receptive  field. 


(b)  Number  of  elements  per  ring: 


y  N 


where  R  is  eccentricity  from  fovea. 


(2.19) 


(2.20) 


(c)  The  relationship  for  eccentricity  between  rings  is,  see  Fig.  11.9(a), 


-=A  +Vi4  2— 1 


A  =tan20+- 


(2.21) 


(2.22) 


(d)  The  relationship  between  the  eccentricity  and  the  radius  of  the  central 
region  for  a  non-overlapping  receptive  field: 


JThese  radii  refer  to  the  dimension  for  the  positive  part  of  the  Laplacian-Caussian  function.  The  radii 
for  the  negative  part  are  actually  larger. 
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r  noj  =Ri  simp 


(2.23) 


By  starting  with  given  values  for  Ri  ,  r0  and  the  overlapping  factor, 
the  values  of  rings  and  the  number  of  elements  per  ring  can  be  calculated, 
and  also  their  dimensions,  using  the  above  relations. 

(2)  Discrete  convolution 

Since  the  sampling  grid  is  discrete,  the  value  of  f(Rcos</>-rcos0,  Rsintf>- 
rsin0)  is  only  a  function  of  8  in  0  ^  r  ^  1,1  ^r<2,  2<r<3,  etc. 
Thus, 


w.v 

gdiscrete  (7?  .0)=27T/'oo  fw(Rr  \dr 


+Vfli(/rio+7:’n+/:’i2+i:’i3+  •  •  ■  +jFl7^  w(Rr)rdr  ( 

2.5 

"b  V®2(7^: 20'^'F 2l"b F 22"b F 23"b F 24'b F 25"b F 26"b F 27  '  *  *  w(Rj-)rdr  +  ■ 


(2.24) 


where  the  F’s  have  been  indicated  in  Fig.  11.9(b). 


V0i=- 


V02=- 


and  normalizing  to  2tt, 


g discrete  (F  »0)  F()0  f  w(Rr)rdr 


+  g-(Fio+F11+Fi2+F13+  '  '  '  +Fll^1[ w(Rj’)rdr 


(2.25) 


«  2.5 

+-j^(Tr20+T:’2l+F22+.F23+.F24+F25+/:’26+2727  ^ w  (R  r  )rdr  +  ■  ■ 


»  .  •  -  *  ■  '  »  **  *  »  V«  a*  a*  ■'  ■  -  K  -  ■  ^  ■  — 


is  very  small. 


II.3.4.2.  Results 

Edge  detection  simulation  by  means  of  the  above  procedure  was  per¬ 
formed  using  a  white  square  on  black  background,  Eig.  II.  10(a),  and  a  noisy 
photograph  of  a  woman’s  face  in  gray  level.  Fig.  11.12(a).  Figs.  II.  10(c). (dl 
and  II. 1 1(c), (d)  show  the  edges  of  the  square.  I-'igs.  II.  12(d),  (e)  and 
II. 13(c), (d),(e),(f)  show  the  edges  of  the  woman’s  face.  The  number  of  sam¬ 
pling  points  indicated  in  Figs.  II. 10  and  11.12  is  71  by  32  by  choosing  r.,-1 
pixel,  2?  !=  1 8  pixels  and  of=0.2  and  in  Figs.  II. 11  and  11.13.  is  113  by  .51  by 
choosing  r0i=lpixel,  i=  1 8  pixels  and  of=0.5.  The  convolution  lor  the  origi¬ 
nal  images  produces  the  positive  values,  negative  value's  and  zero  values. 
The  real  edges  are  the  zero-crossing  points.  The  edges  are  not  quite  straight 
lines  in  Fig.  II.  10,  especially  at  corners,  because  of  the  discrete  nature  and 
small  number  of  the  sampling  points.  Since  the  distance  between  sampling 
points  increases  linearly  with  eccentricity,  this  is  a  non-uniform  sampling 
case,  and  the  greater  the  distance  between  sampling  points,  the  larger  the 
error.  When  the  number  of  sampling  points  is  increased,  as  in  Fig.  II.  11,  the 
results  are  much  better.  This  characteristic  coincides  with  the  experiment  on 
peripheral  vision.  In  the  PVS  experiment,  the  object  which  is  perceived  at 
greater  eccentricity  is  more  distorted.  The  images  of  the  lady's  face  in  Fig. 
11.12  and  11.13  are  very  noisy,  but  the  resulting  images  are  still  recognizable. 
Although  this  simulation  procedure  only  provides  a  rough  or  approximate! 
edge  of  an  image  and  the  computation  is  complicated,  it  compresses  the  or:g; 
nal  image  data  (and  thus  saves  memory  space)  for  further  processing,  siun 
as  motion  detection,  consequently  saving  computing  tune. 


Image  after  edge  detection  in  image  plane:  bright  points  are  posdive 
values:  dark  points  are  negative  values. 


II.  10  h'dge  Detection  Simulation  Using  HVS  Detection  Model  For  71  by 
32  Sampling  Points. 


(c)  Zero-crossing  points  (real  edges)  in  image  plane 


(d)  Real  edges  in  computation  plane 


Fig. II.  10  Edge  Detection  Simulation  Using  HVS  Detection  Model  For  71  by 
32  Sampling  Points 


(a)  Image  after  edge  detection  in  image  plane:  bright  points  are  positive 
values;  dark  points  are  negative  values 


Fig.II.ll  Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113  by 
51  Sampling  Points. 


(c)  Zero  crossing  points  (real  edges)  in  image  plane 


(d)  Real  edges  in  computation  plane 


Fig. II.  11  Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113  by 
51  Sampling  Points. 


(a)  Original  image:  noisy  photograph 
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(c)  Image  after  edge  detection,  computation  plane 


(d)  Zero  crossing  edges,  image  plane 


I'ig. II.  12  Edge  Detection  Simulation  Using  HVS  Detection  Model  For  71  by 
32  Sampling  Points. 


(a)  Image  after  edge  detection,  image  plane 


(b)  Image  after  edge  detection,  computation  plane 


Fig.II.13  Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113  by 
51  Sampling  Points 


(c)  Zero  crossing  edges,  image  plane,  no  thresholding 


/ 


(d)  Zero  crossing  edges,  image  plane,  threshold  -  20 


Fig. II. 13  Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113  by 
51  Sampling  Points 


(e)  Zero  crossing  edges,  computation  plane,  no  thresholding 


Fig.II.l3  Edge  Detection  Simulation  Using  HVS  Detection  Model  for  113  by 
51  Sampling  Foints 
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H.4.  Edge  Detection  Simulation  for  New  Sensor 

As  indicated  in  Chapt.  1,  there  are  three  basic  geometries  for  the  new 

I 
t 

sensor: 

(1)  Arcs  of  ring 

(2)  Circular  elements 

(3)  Hexagonal  elements 

The  image  is  acquired  by  the  new  sensor’s  image  plane  and  the  edge 
detection  and  motion  detection  is  accomplished  in  computation  plane.  Fig. 

11.14  explains  the  relationship. 

For  the  arcs  of  ring  sensor,  the  mapping  in  computation  plane  is  a  rec¬ 
tangular  array,  so  the  edge  detection  in  this  plane  can  use  a  variety  of 
methods,  such  as  the  local  neighborhood  methods  (Roberts  operator,  Prewitt 
operator  and  Sobel  operator  etc.),  regional  methods  (Laplacian  Gaussian),  glo¬ 
bal  methods  (signal  analysis)  etc.  [17,18]. 


New  Sensor 

Computational  Plane 

(  image  plane. 

- » 

(  edge  detection  and 

acquire  an  image  ) 

motion  detection  ) 

Fig.  11.14.  Block  diagram  of  image  processing  procedure  for  the  new  sensors. 
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For  the  circular  and  hexagonal  sensors,  the  mapping  to  computation 
plane  is  staggered,  so  another  method  is  needed  to  extract  the  edge.  The  fol¬ 
lowing  local  neighborhood  methods  to  detect  edge  were  used  to  determine  the 
gradient  at  pixel  alt  refer  to  Fig.  11.15. 

(1)  Absolute  value  method: 

g  =  la  !-a2 1+  la  i-a3 1+  L  j-a4 1+  la  !-a5 1+  L  i-a6 1+  la  ,-a  7 1  (2.27) 


HI 

M 


Fig.  U.15.  Circular  elements  and  hexagonal  elements  neighborhoods  in 
computation  plane. 


(2)  Laplacian  method:  (See  Fig.  11.16) 

g  =  fa  i-a  2 1  +  (a  i-a  3 1  +  fa  i-a  4 1  +  (a  !-a  5 1  +  fa  t-a  6 1  +  |a  ,-a  7 
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Inpul  Image 


Laplacian 

Operation 


Zero-crossing 

Points 


Fig.  11.16.  Block  diagram  of  the  Laplacian  operation. 

(3)  Using  the  Laplacian  of  Gaussian  function. 

The  general  edge  detection  scheme  is  indicated  in  the  block  diagram  of 
Fig.  11.17. 


Edge 

11.4.1.  Simulation  procedure  and  results 

11.4.1.1.  Input  the  image  from  circular  sensor 

Input  the  image  from  the  image  plane  of  the  circular  sensor.  Edge 
detection  is  implemented  in  computational  plane.  The  examples  of  this  simu¬ 
lation  are  shown  in  Figs.  11.18,19,20  and  21.  The  original  image  in  Fig.  11.18 
is  binary  and  the  original  images  in  Figs.  11.20  and  21  are  very  noisy  pic¬ 
tures.  From  the  examples,  the  absolute  value  method  produces  thick  edges,  so 
a  thinning  operation  should  be  used.  For  non-binary  pictures,  the  absolute 
value  and  Laplacian  methods  need  thresholding,  but  not  necessarily  the 
Laplacian-Gaussian  method.  The  absolute  value  method  and  Laplacian 
method  are  very  fast  and  simple  for  edge  detection.  The  Laplacian-Gaussian 
function  is  slow  and  complicated  for  edge  detection,  but  it  produces  good 
results  for  noisy  images. 

II.5  Savings  in  Computations  for  the  New  Sensor  Compared  to  Rectangular 
Sensor 

Because  of  the  small  number  of  elements  in  the  new  sensor  compared  to 
a  conventional  rectangular  array,  the  number  of  computations  for  image  pro¬ 
cessing  is  reduced  dramatically.  For  example,  edge  detection  using  the  abso¬ 
lute  value  method  or  the  Laplacian  method  needs  11  additions  per  pixel,  but 
the  total  number  of  operations  is  less  than  using  the  Sobcl's  edge  operator 
for  the  rectangular  sensor.  The  computational  time  for  edge  operation  of  the 
new  sensor  using  71  by  34  elements  will  be  only  one  hundredth  compared 
to  that  of  the  rectangular  sensor  using  512  by  512  pixels,  and,  as  can  be 
seen  from  the  edge  image  of  Fig.  11.18(a),  for  example,  the  main  features  of 


the  image  should  still  be  recognizable. 

11.6.  Comments  and  Conclusion 

In  the  previous  sections,  we  have  presented  ,and  illustrated  by  means  of 
examples,  a  mathematical  model  of  processing  performed  by  the  peripheral 
visual  system  and  the  new  sensor,  based  on  the  properties  discussed  in  Sect. 
II.  1  and  Sect.  II.4. 

Although  the  simulation  of  edge  detection  for  the  human  PVS  proves 
the  existence  of  preprocessing,  it  might  be  difficult  to  implement  it  in 
hardware  and  more  theoretical  research  is  necessary  before  a  working  model 
for  hardware  implementation  is  developed.  Comparing  these  two  simulations, 
the  results  are  very  similar.  The  image  plane-computation  plane  sensor  based 
in  the  HVS  should  be  simpler  to  implement  in  hardware  but,  as  mentioned 
in  Chapt.  II,  more  research  is  necessary  on  the  physical  lay-out  and  also  on 
the  etFects  of  resolution  reduction  on  pattern  recognition  techniques  and  on 
how  to  apply  established  a  new  pattern  recognition  techniques  to  images  in 
the  computation  plane. 


(ay  Original  image:  white  square  on  black  background 


(b)  Mapping  of  image  to  computation  plane 


Fig.II.18  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (34 
Rings  74  Elements  per  Ring). 


(c)  Edge  detection  in  computation  plane  by  absolute  value  method  and  no 
thresholding 


(d)  Edge  detection  in  CP  by  absolute  value  method;  threshold  -  120 


Fig. II.  18  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (34 
Rings  74  Elements  per  Ring). 


(e)  Edge  detection  in  CP  by  Laplacian  method,  no  thresholding 


(0  Edge  detection  in  CP  by  Laplacian-Gaussian  method,  no  thresholding 


Fig.II.18  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (34 
Rings  74  Elements  per  Ring). 


Fig.II.  19  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (34 
Rings,  74  Elements  per  Ring). 
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(a)  Original  grey  level  image:  dark  frame  on  light  background 


(e)  Edge  image  in  CP,  Laplacian  method,  threshold  =  20 


(f)  Edge  image  in  CP,  Lapacian-Gaussian  method,  no  thresholding 


Fig.  11.20  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (34 
Rings,  74  Elements  per  Ring). 


Cc) 


Edge  image  in  CP,  absolute  value  method,  threshold  -  55 


(d)  Edge  image  in  CP,  Laplacian  method,  threshold  =  15 


Fig. II. 21  Edge  Detection  Using  Simulation  of  Circular-Elements  Sensor  (55 
Rings,  113  Elements  per  Ring). 
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CHAPTER  III 

QUALITATIVE  MOTION  DETECTION  ALGORITHMS 

III.  1  -  Introduction 

In  this  chapter,  algorithms  for  qualitative  detection  of  motion  will  be 
developed.  By  this  we  mean  that  using  information  from  the  computation 
plane  (CP),  a  decision  will  be  made  in  software  on  the  direction  of  motion, 
without  a  quantitative  determination  of  the  increments  in  the  x  and  y  direc¬ 
tions  in  image  plane  (IP).  The  following  assumptions  will  be  made: 

1.  The  image  has  been  mapped  to  the  computation  plane,  segmented  by 
edge  detection  in  CP  and  objects  are  represented  by  their  edges. 

2.  Sampling  rate  is  fast  enough  so  that  only  motions  small  in  com¬ 
parison  to  object  size  need  be  considered. 

The  following  are  cases  of  interest: 

a.  Scaling  about  the  optical  axis. 

b.  Rotation  about  the  optical  axis  (OA). 

c.  Scaling  plus  rotation  both  about  the  OA. 

d.  Translation  along  a  straight  line  in  image  plane  (IP). 

e.  combination  of  (a)  and  (d),  above. 

f.  Combination  of  (b)  and  (d),  above. 

g.  Combination  of  (a),  (b)  and  (d),  above. 
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These  cases  have  to  be  considered  for  single  or  multiple  object  scenes 
with  objects  either  enclosing  or  non-enclosing  the  optical  axis.  Initially  we 
will  consider  only  single  object  scenes. 

III.2  Magnification  and  Rotation 

III.2.1.  Object  Edges  Enclosing  the  Optical  Axis. 

We  will  refer,  first,  to  the  case  of  edges  enclosing  the  optical  axis  (in 
IP,  obviously).  Cases  (a)  and  (b)  are  then  very  simple  because  for  these 
two  situations  the  properties  of  the  log  conformal  transformation  produce  the 
well  known  invariances  with  shifting  along  the  V"  and  "i>"  axes  of  the  CP 
plane,  for  scaling  and  rotation,  respectively.  In  these  two  cases,  in  addition 
to  easy  determination  of  the  direction  of  motion,  it  is  also  easy  to  determine 
corresponding  points  between  the  original  and  the  displaced  edges,  because 
edges  remain  invariant  in  shape  and  are  only  shifted.  Local  maxima  and 
minima,  easy  to  determine  in  the  original  and  the  new  (from  now  on  the 
"previous"  and  the  "current"  images,  PI  and  Cl,  respectively)  will  be 
corresponding  points  in  both  images.  An  example  of  a  scaled  and  a  rotated 
image  in  CP  for  the  random  figure  in  IP  of  Fig.  1  are  given  in  Figs.  1(a) 
and  1(b),  respectively.  For  the  scaled  case,  if  the  difference  image  (DI),  i.e., 
the  subtraction  of  the  PI  from  the  Cl,  contains  Cl  points,  scaling  has  been 
up  (M>1);  if  the  DI  contains  PI  points,  M<1,  Figs.  2(a)  and  2(b),  respec¬ 
tively.  In  other  words,  the  object  is  closer  to  the  camera  or  farther  away, 
respectively.  For  the  rotation  case,  the  DI  contains  both  Cl  and  PI  points, 
but  maxima  and  minima  values  of  /j.  do  not  vary.  We  wish  to  determine 
whether  rotation  is  CW  or  CCW.  Realizing  that  the  vertical  axis  value  in 


the  CP  is  equal  to  the  phase  angle  of  the  corresponding  point  in  the  IP,  it  is 
enough  to  locate  the  value  of  v  corresponding  to  either  the  maximum  or  the 
minimum  value  of  /x  in  both  PI  and  Cl.  If  this  corresponding  value  of  v  is 
larger  in  Cl,  it  means  that  the  rotation  angle  is  positive,  i.e.,  CCW,  Fig. 
3(a).  If  this  corresponding  value  of  v  is  smaller  in  Cl,  the  rotation  is  nega¬ 
tive,  i.e.,  CW,  Fig.  3(b).  For  scaling  plus  rotation,  a  combination  of  the  two 
properties  described  above  applies.  For  test,  locate  either  the  maximum  or 
the  minimum  value  of  /i  for  both  Cl  and  PI.  Shift  the  Cl  edge  up  or  down 
by  the  difference  in  v  value  between  maxima  and  minima  of  fi.  This  will 
eliminate  rotation  and,  if  only  scaling  and  rotation  have  occurred,  the  DI 
will  now  contain  only  Cl  points  or  PI  points.  Figure  4  shows  an  original 
image  plus  a  scaled/rotated  one.  Notice  that  the  shape  of  the  edge  has  not 
varied,  it  has  just  shifted  in  both  the  /i  and  the  v  directions.  For  an  image 
that  has  been  translated,  the  DI  image  will  contain  both  PI  and  Cl  points, 
Fig.  5,  and  in  addition,  maxima  and  minima  values  of  fi  will  be  different  in 
both  images. 

III.2.2  Objects  with  Edges  not  Enclosing  the  Optical  Axis 

It  is  convenient  to  emphasize  that  the  properties  pertaining  to  scaling 
and  rotation  apply  regardless  of  whether  the  objects  enclose  the  optical  axis 
or  not,  as  long  as  the  scaling  or  the  rotation  are  with  respect  to  the  optical 
axis.  If  the  original  test  figure  is  translated  until  it  does  not  enclose  the 
optical  axis  and  then  it  is  either  scaled  or  rotated  or  both,  the  properties 
stated  earlier  still  apply,  i.e.,  object  shape  remains  invariant,  but  there  will 
be  translation  along  the  fi  axis  for  scaling  and  along  the  v  axis  for  rotation. 
There  is,  however,  a  fundamental  difference  between  the  edge  of  an  object 
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enclosing  the  optical  axis  and  one  that  does  not.  In  the  former  case,  as  the 
edge  contour  is  followed  in  IP  from  an  initial  point  until  that  point  is 
reached  again,  the  phase  angle  (value  of  v  in  the  CP)  varies  by  2v.  This 
means  that,  in  CP,  the  object’s  edge  is  open.  On  the  other  hand,  for  an 
object  not  enclosing  the  optical  axis,  when  the  contour  is  followed  in  IP,  the 
net  variation  of  the  tingle  is  zero  and  the  edge  is  closed  also  in  CP,  see  Fig. 
6.  The  object  in  this  figure  is  the  same  as  the  original  for  Fig.  1,  but  it 
has  been  displaced  until  it  does  not  enclose  the  optical  axis.  Notice  that  for 
three  different  sizes  of  the  object  (M-0.8,  M-l,  and  M—1.2),  the  shape  and 
size  in  CP  do  not  vary,  but  the  shifting  along  the  x  axis  does,  Fig.  7. 
Notice  also  that,  contrary  to  what  happens  when  the  object  encloses  the  opti¬ 
cal  axis,  the  difference  image  contains  both  PI  and  Cl  points.  This  means 
that  a  different  criterion  is  needed  for  both  cases  in  order  to  determine  direc¬ 
tion  of  motion.  Notice  that  scaling  of  noncentered  objects  in  IP  maps  to  CP 
in  a  form  similar  to  translation  in  IP  and  that  consequently,  a  criterion 
similar  to  that  used  by  Jain  [1]  can  be  applied  to  obtain  motion  information. 
For  scaling  of  off-center  objects  about  the  optical  axis,  compute  the  difference 
image.  If  only  scaling  exists,  there  will  be  a  left  hand  side  (LHS)  and  a 
right  hand  side  (RHS)  edge  composed  of  PI  and  Cl  only,  respectively,  or  vice 
versa  in  the  DI.  If  the  LHS  edge  has  Cl  points  and  the  RHS  edge  has  PI 
points,  scaling  has  been  M<1.  If  the  LHS  edge  has  PI  points  and  the  RHS 
edge  has  Cl  points,  scaling  has  been  M>1,  refer  to  Figs.  6  and  8,  respec¬ 
tively. 

Notice  that  in  either  case,  minimum  and  maximum  values  of  v  remain 
invariant,  which  can  be  used  as  a  criterion  to  determine  whether  only  scaling 


exists. 


For  rotation,  the  off-center  case  is  also  different  from  the  centered  case. 
The  closed  edge  in  CP  moves  up  or  down,  respectively,  for  CCW  and  CW 
rotation  without  changing  either  shape  or  size.  The  difference  image  will 
contain  both  Cl  and  PI  points,  Fig.  9.  If  only  rotation  occurs,  the  DI  will 
contain  an  upper  and  a  lower  edge  with  only  PI  and  Cl  points,  respectively, 
or  vice  versa.  If  the  upper  DI  edge  contains  only  Cl  points  and  the  lower 
edge  only  PI  points,  rotation  has  been  CCW.  If  the  contrary  is  true,  rota¬ 
tion  has  been  CW. 

Notice  that  in  either  case,  minimum  and  maximum  values  of  /j.  remain 
invariant,  which  can  be  used  as  a  criterion  to  determine  whether  only  rota¬ 
tion  exists. 

For  the  scaling  plus  rotation  case,  the  method  described  for  the  "cen¬ 
tered"  case,  also  applies  to  the  off-centered  case.  If  this  method  is  applied  to 
Figs.  10  and  11,  correct  results  are  obtained.  Of  course,  once  the  two 
images  are  "aligned"  with  respect  to  the  y  axis,  the  criterion  for  off-center 
scaled  images  must  be  applied. 

We  have,  thus,  covered  cases  (a),  (b)  and  (c)  for  single  objects,  centered 
and  off-center. 

III.2.3.  Multiple  Objects 

For  multiple  objects,  the  same  properties  and  criteria  apply  that  apply 
for  single  objects.  Two  general  cases  can  occur:  (a)  motion  of  the  camera: 
(b)  motion  of  objects  in  the  scene. 


For  case  (a),  if  the  objects  are  static,  the  complete  scene  will  vary 
simultaneously.  In  other  words,  if  the  orientation  of  the  camera  does  not 
vary  but  the  camera-scene  distance  does,  all  the  objects  will  be  scaled.  For 
rotation  about  the  optical  axis,  all  objects  will  rotate  simultaneously.  Some 
objects  will  be  centered  and  some  off-center.  The  centered  square  and  off- 
center  rectangle  of  Fig.  12(a)  are  mapped  as  indicated  in  Fig.  12(b).  Figure 
12(c)  shows  the  mapping  of  the  scene  after  rotation  by  15°  and  Fig.  12(d) 
after  scaling  by  M=1.2.  Simultaneous  rotation  and  scaling  are  shown  in  Fig. 
13.  Notice  that  although  scaling  or  rotation  alone  produce,  in  this  case, 
overlapping  PI  and  Cl  for  the  off-center  object,  the  combination  of  both  pro¬ 
duces  nonoverlapping  images,  Fig.  13. 

III.3  Translation  Along  a  Straight  Line  in  Image  Plane 

This  is  a  more  difficult  problem  than  scaling  and  rotation,  because  the 
mapping  from  IP  to  CP  does  not  possess,  in  this  case,  the  useful  properties 
that  apply  to  scaling  and  rotation. 

For  geometric  figures  such  as  squares,  rectangles,  circles  and  ellipses,  as 
well  as  for  most  nongeometrical  objects,  the  following  qualitative  algorithm 
applies  for  centered  figures: 

Consider  the  DI,  i.e.,  the  labeled  absolute  value  of  the  difference  between 
the  current  image  and  the  previous  image  intensities. 

1.  Horizontal  motion 

a)  If  the  DI  contains  more  Cl  points  for  values  -v/2<v<tt/2  than  for 
Tr/2<v<2)v/2  and  more  PI  points  for  v/2<v<in/2  than  for  -tt/2<v<tt/2, 
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motion  is  the  +x  direction  in  IP. 

b)  If  the  DI  contains  more  Cl  points  for  values  n/2<v<3v/2  them  for 
-77-/2 <y <37772,  and  more  PI  points  for  -ttI2<v<tt/2  than  for  tt/2<v<3tt/2 
motion  is  in  the  -x  direction  in  IP. 

2.  Vertical  Motion 

a)  If  the  DI  contains  more  Cl  points  for  0<v<n  than  for  tt<v<2tt 
and  more  PI  points  for  ir<v<2ir  them  for  Q<v<n,  motion  is  in  the  +y 
direction  in  IP. 

b)  If  the  DI  contains  more  Cl  points  for  ir<v<2n  than  for  0<v<ir 
and  more  PI  points  for  0<y<7r  than  for  ir<v<2ir,  motion  is  in  the  -y 
direction  in  IP. 

Examples  for  geometric  objects  are  given  in  Figs.  14  to  16. 

The  method  also  applies  to  random  figures  such  as  the  one  shown  in 
Fig.  1  which  is  a  difficult  figure  because  of  its  concave-convex  configuration. 
Figures  17  to  22  represent  the  results  of  translations  in  different  directions, 
all  of  which  are  correctly  determined  by  the  above  method. 

For  noncentered  figures,  there  is  a  change  in  figure  shape,  in  addition  to 
shifting  in  the  computation  plane,  for  translation  in  the  image  plane.  The 
qualitative  algorithm  described  above  for  centered  figures  does  not  apply  in 
this  case.  The  problem  is  under  study  at  present.  Some  general  properties 
of  the  natural  log  conformal  transformation  can  be  used.  For  example,  if 
motion  is  along  a  straight  line  at  a  certain  angle,  although  the  noncentered 
object  will  diminish  in  size  in  CP  as  it  moves  away  from  the  origin  in  IP, 
the  "v"  value  in  CP  (corresponding  to  the  angle  between  the  line  of  motion 


a)  (A)  Centered,  (B)  off-center 

b)  (A)  Centered,  (B)  off-center 

c)  (A)  Centered,  (B)  off-center 
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and  the  horizontal  axis  in  IP)  will  remain  constant  for  a  given  feature  of 
the  object’s  edge.  When  the  random  figure  of  previous  examples  is  off-center 
by  (4,4)  units,  the  line  from  the  "center"  of  the  figure  to  the  origin  is  at  45 

degrees.  For  off-center  at  (5,5),  the  figure  is  moving  along  the  line  at  45 

degrees  in  IP  and  the  displacement  has  been  (1,1).  Figure  23  represents  the 
situation  in  CP.  Comparing  this  figure  with  Fig.  6  which,  we  recall, 
represents  the  random  figure  off-center  by  (4,4)  with  m=l  and  with  m=0.8, 
we  see  that  the  CP  edge  images  are  relatively  similar.  There  is,  however,  a 
very  fundamental  difference:  the  area  of  the  two  figures  in  Fig.  6  is  exactly 
the  same,  while  in  Fig.  23  it  is  different.  A  simple  way  of  distinguishing 

between  scaling  (or  rotation)  and  translation  is  by  comparing  the  area  of  the 

PI  and  the  Cl  objects  of  interest.  Figure  24  illustrates  the  properties  of 
translation  along  straight  lines  for  off-center  figures.  A  and  B  are  the  PI 
and  Cl  for  motion  along  a  straight  line  at  60  degrees;  B  is  displaced  by 
(1,1.73)  with  respect  to  A.  C  and  D  are  the  PI  and  Cl  for  motion  along  a 
straight  line  at  120  degrees;  D  is  displaced  with  respect  to  C  by  (-1,1.73). 

III.  4  Conclusions  and  Future  Plans 

In  this  chapter  we  have  presented  qualitative  algorithms  which  permit  to 
determine  the  direction  of  motion  for  scenes  under  magnification  and  rotation 
and,  for  centered  figures,  for  translation  in  IP.  These  algorithms  can  be 
applied  to  multiple  object  images  for  nonelastic  motion  (i.e.,  all  objects  are 
magnified,  rotated  or  moved  at  the  same  rate).  When  completed,  these  algo¬ 
rithms  could  be  used  in  conjunction  with  the  quantitative  algorithms 
presented  in  the  next  chapter  for  target  or  object  tracking. 
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The  next  two  steps  for  rigid  motion  are: 

a)  completing  the  algorithm  to  include  translation  of  off-center  objects. 

b)  developing  a  program  to  implement  the  algorithms.  Both  of  these  phases 
are  currently  under  progress. 

Research  of  dynamic  scenes,  especially  those  consisting  of  non-rigid  or 
elastic  motion  is  being  actively  pursued  in  several  research  centers,  and  its 
extension  to  the  new  sensor  should  be  seriously  considered. 
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CHAPTER  rv 

ALGORITHMS  FOR  TARGET  TRACKING 
USING  THE  BVS  SENSOR 

IV.  1  Introduction 

The  development  of  algorithms  for  a  real  time,  automatic  system  capable 
of  tracking  2-D  targets  in  complex  scenes,  is  discussed  in  this  chapter.  The 
algorithms  developed  are  based  upon  the  new  sensor  which,  as  discussed  in 
previous  chapters,  produces  shape  invariance  in  C.P.  under  magnification  or 
rotation  about  the  optical  axis  in  I.P.  These  properties,  however,  do  not 
apply  when  an  object  deviates  from  the  reference  location  with  respect  to  the 
origin  in  the  image  plane.  Significant  distortion  occurs  in  the  pattern  in 
computation  space  when  objects  experience  translation  in  image  plane. 

In  this  chapter,  three  algorithms  which  can  ultimately  be  used  for  track¬ 
ing  an  object  in  computation  plane  are  developed.  The  first  algorithm  esti¬ 
mates  amount  of  distortion.  Ax  and  Ay,  when  the  object  experiences  transla¬ 
tion  only.  The  second  estimates  object  perturbations  such  as  rotation,  dila¬ 
tion,  and  translation  (or  any  combination  of  the  three).  The  third  algorithm 
is  based  on  the  intensity  function  and  avoids  the  use  of  corresponding  points. 

IV.2  Linear  estimation  of  target  perturbations 
utilizing  the  logarithmic  function 

In  this  section,  we  develop  two  techniques  which  can  be  used  (under 
some  circumstances)  to  measure  small  perturbations  of  target  images  in  com¬ 
putation  plane.  These  techniques  are  mainly  based  on  the  logarithmic  func¬ 
tion.  The  first  technique  applies  to  a  translational  case  only.  The  second 


applies  to  the  general  case  of  scaling,  rotation,  and  translation. 


IV.2.1  Translational  case 

If  two  successive  image  frames  are  considered,  their  differences  are 
approximately  equal  to  a  linear  combination  of  the  components  of  the  dis¬ 
placement  of  the  target.  If  all  points  of  the  frame  undergo  the  same  move¬ 
ment,  i.e.,  if  motion  is  rigid,  then  the  perturbation  estimation  problem  is 
solved  using  linear  estimation.  Let  Ax  and  Ay  be  the  components  of  target 
displacement  in  the  x  and  y  directions,  respectively.  By  Taylor  Series 
expansion,  the  frame  differences  are 


/  (x  +Ax  ,y  +Ay  )  -  /  (x  .y  ) 
where 


a/(*-y) 

d*  * 


Ax  + 

=  *n 


9/ 

ay 


Ay  +  T)(x  ,y  )  (1) 

y  =*n 


f(x.y)  =  ^-ln(x2+y2)  +  ytan"1^ 


/(x+Ax.y+Ay)  =  yln{(x+Ax)2  +  (y  +Ay)2}  +  y'tan"1 


y+Ay 


x+Ax 


dx 


x2+y2 


(2) 


dy  x*+y* 

The  term  r)(x,y)  takes  into  account  both  various  types  of  noise  and  the 


higher  order  terms  of  the  Taylor  Series  expansion. 


Notice  that  to  write  Cl)  we  require  f(x.y)  to  be  differentiable.  To  be 
differentiable,  f(x.y )  must  be  an  analytic  function  in  a  domain  D  where 


D  :r  >0  :  0<<(><2v 

Thus,  /  (x  ,y )  is  always  differentiable  since  its  branch  cut  includes  origin  and 
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x-axis  where  x>0.  In  this  domain,  the  first  order  partial  derivatives  of  its 
component  functions  must  satisfy  the  Cauchy-Riemann  equations  [1]. 

Now  letting 


=  /  (x  +  Ax  .y  +  Ay  )  —  /  (x  ,y  ) 


equation  (1)  becomes 


A T(i)  =  a(i  )Ax  +0(t  )Ay  +T)j  ~  a(i  )Ax  +/3(i  )Ay , 

i  =  (4) 

where  we  have  included  the  dependence  on  x.y  in  the  index  i,  and  m  is  the 
number  of  sampling  points. 

Since  Ax  and  Ay  are  constant  due  to  the  rigid  motion  assumption,  we 
can  use  linear  regression  to  get  Ax  and  Ay.  Introducing  an  error  term  (rf), 


(4)  becomes 


AT;  =  a,  Ax  +/3j  Ay  +r,- 


rt  =  ATj-aiAx-/31Ay 

Use  the  minimum  mean  square  error  method  to  solve  for  Ax  and  Ay. 
Irjl2  =  n  r~ 

-  (ATj  —atj  Ax  —0,  Ay  XATi—aj  Ax  — /3j  Ay  ) 


=  I  Ar,  1 2-a,  Ax  AT,  -fa  Ay  AT,  -fa  Ay  AT,  - 
Ax  A Ti  + 1  «j  1 2Ax2+«i  /3,  Ax  Ay  + 


Ij3;  l2Ay2+aj/3j  Ax  Ay 


For  m  data  points  (6)  becomes 


=  £  I  AT,  1 2+ 1  aj  1 2  Ax  2+ 1  (3, 1 2Ay2— 2Re(a;  A T,  )Ax  - 
i=i  l 

2Re(j3j  ATjAy+lReCaj^OAxAyj  (7) 

Now  taking  derivatives  of  S  with  respect  to  Ax  and  Ay,  and  setting  them 
equal  to  zero,  we  obtain 

=  f  [2lail2Ax-2Re(aiAfi)+2Re(5i/3j)Ay] 

=  0  (8) 

and 

=  £  [210, 1 2 Ay  -2Re(0,  AT,  )+2Re(S,  0, )  Ax  ] 

=  0  (9) 

Solve  (8)  and  (9)  simultaneously  for  Ax  and  Ay  to  obtain 

EReCafjATi) 

Ax  =  Ax  =  - —  (10) 

i=  1 

£  Re(/3j  AT, ) 

Ay  =  Ay  =  j -  (11) 

lift  I2 

i=l 

where 

la,  I2  =  10, 12 

=  1  (12) 

*.2+yi2 

and 


Re(0,A  Ti)  =  — Imla.Ar,) 


(13) 


V •  . 


Since 


x  =  e  cosv 


y  —  e“sinv 


substitute  (14)  and  (15)  into  (2).  Thus,  a  and  0  become 


a  =  e -<«+>> 


/3  =  je~(u+Jv) 


Notice  that  a  and  0  both  are  expressed  in  xy  coordinates  (image  plane 
coordinates).  To  express  them  in  computational  plane  coordinates  (uv  coordi¬ 
nates),  we  may  proceed  as  follows: 


and  (12)  becomes 


laj  I2  =  10;  I2 


Looking  at  (10)  and  (11),  it  is  clear  that,  if  the  frame  difference,  AT;, 
can  be  measured  accurately,  the  estimation  of  target  displacements  should 
yield  accurate  results  (see  computer  simulations,  sect.  IV.3).  It  should  be 
noted  that  this  particular  approach  is  similar  to  that  proposed  in  [2]. 

In  the  next  section  we  will  introduce  the  algorithm  to  estimate  target 
displacements  in  the  case  of  translation,  rotation,  and  scaling. 


IV.2.2  Translation,  Rotation,  and  Scaling 

This  section  is  concerned  with  the  development  of  an  algorithm  for  the 
case  of  translation,  rotation,  and  scaling.  The  approach  used  is  similar  to 
that  of  Schalkoff  and  McVey  [3,4].  They  outline  the  overall  problem  of 


visual  target  tracking,  with  emphasis  on  successive  scene  target  modeling  and 
tracking  algorithm.  A  general  3— D  mathematical  model  for  constrained 
frame- to-frame  target  evolution  is  developed.  The  Taylor  Series  Video  Image 
Processor  (TSVIP)  algorithm  is  suggested. 

Following  the  approach  of  [3]  and  [4],  it  is  clear  that  the  frame-to- 
frame  target  perturbations  can  be  adapted  by  using  the  affine  transform 
described  in  [5].  This  means  that  target  motion  is  constrained  to  be  observed 
as  2— D  time-varying  affine  perturbations  of  x  and  y  in  the  plane  perpendicu¬ 
lar  to  the  optical  axis.  This,  however,  does  not  limit  target  motion  to  2— D, 
since  an  object  moving  simultaneously  to  the  right  and  towards  the  camera 
may  be  modeled  by  an  affine  transform  representing  both  dilation  and  trans¬ 
lation.  For  the  sake  of  simplicity,  perturbations  such  as  “roll”  of  a  target 
whose  major  axis  is  in  a  plane  other  than  the  optical  axis  will  not  be  con¬ 
sidered. 

Let 


x’  =  Ax+b 

where  A  denotes  the  homogeneous  affine  transform  matrix  and  b  the  transla¬ 
tion  vector.  Two  well-known  versions  of  the  homogeneous  affine  transform 
are 

A  -  I*  0 

A  [0  K 

where  k  is  a  scaling  factor,  and 

A  _  1  cos©  — sin0 
[  sinO  cosO 
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where  0  is  an  angle  of  rotation  about  the  origin. 


b  -  l&l 

The  frame  difference  can  then  be  written  as 


— (X/l)  A(r2-rl.f1)x+b(f2-?1^1)| 

ci9) 

fix  x=x„  * 

-V. 

AT(x/2)  =  I  U(r2-rl.f1)x 

fix  J  x=x„  ’ 

where  we  define 

A(t2~ ^l^l)  ^  A(t2 — ^l^l)  '/ 

and 

AT(x.f2)  t  /(X*^2)-/(X/1) 
The  matrix  formulation  can  be  defined  as 


^  A  an  an 
—  a.  21  a22 


b  A 
=  (Ay 


A  la  „ 

fix  X=X„ 


A  21 
A  _  <122 


Therefore,  (19)  can  be  rewritten  as 


AT(Xj)  =  [*;«,  yt  a,  Xj/3;  /3f  I  a,  ft]  a2 


From  (20)  it  is  apparent  that  we  can  solve  for  a  by  using  a  least 
square  estimation  approach  as  we  did  in  the  previous  section.  The  most 
obvious  objection  is  that  it  requires  the  inversion  of  a  6x6  matrix  (or 
equivalently  the  solution  of  the  six  corresponding  normal  equations).  As 
mentioned  earlier  in  this  section,  the  target  and  camera  perturbations  are  res¬ 
tricted  to  rotation,  dilation,  and  translation  (or  any  combination  of  the  three) 
in  the  plane  perpendicular  to  the  optical  axis.  In  this  case  we  can  let 


fll  ~  all  —  a22 


and 


a2  —  a  12  —  ~ ^21 

and  (20)  can  then  be  rewritten  as 


AT(X,)  =  [xidi+yiPi  XiPi-yiOti  I  a,  ft] 
Written  more  compactly,  (21)  yields 


ai 

a2 

Ax 

Ay 


where 


AT(Xj)  =  [H  I  G  ]  a 

G  =  [aj  ft] 

H  =  [xjCXj+yi  Pi  Xift-y.a;] 


a  = 


ai 

a2 

Ax 

Ay 


ac 

b 


or, 


(21) 


(22) 


AT  =  H  ac  +G  b 


(23) 


y  ■ i.*.'  r.'F7 .  y .-  y  1  ■.■ 


*-■  y  t*.  «rj  y.' 


I 


S 


f- 


r. 


* 


v 


y 

* 
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Thus,  the  problem  is  now:  given  (22),  generate  a  “good”  estimate  of  a. 
Again,  the  least  squares  solution  appears  promising.  Let’s  introduce  an  error 
term  (r;).  Then  (23)  becomes 

AT,  =  .H)  ac +Gi  b+r; 

i  =  1  (24) 

or 

r*  =  AT)—//*  ac-Gj  b  (25) 

Notice  that  H  and  G  are  complex  matrices  and  their  dimensions  are  Nx 2. 

AT  and  r  are  also  complex  matrices  and  both  of  them  have  dimensions  of 

Nxl.  ac  and  b,  however,  are  real  matrices  and  their  dimensions  are  2X1. 

Dropping  subscript  i  and  substituting  H,  G,  ac,  and  b  into  (25),  we  obtain 

r  =  AT— (xa+y/3)al— (x/3— ya)a2— «Ax— )3Ay  (26) 

The  conjugate  of  r  can  be  written  easily  as 

r  =  AT—  Cca+y/3)a!— (x/3— ya)a2~  aAx  —  /3Ay  (27) 

Now  we  can  use  the  minimum  mean  square  error  method  to  solve  for  ac 

and  b. 

rr  -  {AT— (xa+y0)a!— (x0— ya)a2— aAx— 0Ay} 

_  _  ,  (28) 
{ AT  —  (x  a+y  /3  )a  i~ (x  0— y  a  )a  2— a  Ax  — 0  Ay } 

Expand  and  simplify  (28)  for  m  data  points.  Thus,  we  obtain 

m 

S  =  ZriFi 

i=l 


A. 


fS  •* 
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m  X: 

S  =  &3+y? 

m  y- 

R  =  £  T 

i=iXi2+yi2 

p  =  v  1 

i=i*i2+yi2 
9i  =  Re  2  AT,- 


q2  =  Im£A7i 

i=l 

?3  =  Re^ajATi 
i=l 

=  RefftATi 

i=i 

rfi#  =  S2+R2-P 


Again,  we  may  express  (38)  in  uv  coordinates  as 


S  -  22e~“'cosv, 

»=i 

R  =  £e~“'sinvj  (39) 

i=l 

m  1 

*  =  Ztt 

i=i  e  ' 

Notice  that  if  a  target  experiences  only  translation,  then  (36)  and  (37) 
are  identical  to  (10)  and  (11).  The  scaling  factor,  k,  can  be  estimated  as 


k  =  •Ja2+a2  (40) 

Thus,  the  above  results  may  be  used  to  track  the  reference  point  on  the 
target  if  we  can  measure  the  frame  difference  accurately.  This  is  the  so 
called  “correspondence  problem”  which  is  under  consideration  by  a  number  of 
researchers  [9,10,11]  and  for  which  a  general  solution  does  not  exist  yet. 
For  the  interest  of  verifying  the  theoretical  results,  we  will  assume  that  the 
frame  difference  can  be  measured  exactly.  In  other  words,  the  corresponding 


•wi 
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point  problem  is  assumed  to  be  solved. 

TV3  Computer  Simulation 

Computer  simulation  was  performed  to  lend  credence  to  the  theoretical 
results,  in  particular  the  validity  of  the  algorithm  in  section  IV.2.2.  A  rec¬ 
tangle  of  4x6  arbitrary  units  of  length  was  used  to  represent  the  target, 
thus  this  rectangle  may  be  perturbed  exactly  via  the  affine  transform.  A 
32x32  (number  of  sampling  points,  m,  equals  to  32)  scene  was  used.  The 
results  are  as  follows: 

Figs.  IV.l(a)  and  IV.l(b)  compare  exact  and  algorithm  estimates  of  tar¬ 
get  translational  parameters,  i.e.,  Ax  and  Ax,  and  Ay  and  Ay  for  the  case  of 
translation  only.  In  this  case.  Ax  was  varied  in  a  range  of  -2.8  to  2.91  and 
Ay  was  varied  in  a  range  of  —1.8  to  1.82.  As  shown,  the  algorithm  transla¬ 
tional  estimates  are  quite  good  over  the  specified  range  of  Ax  and  Ay  above. 
The  corresponding  errors,  i.e.,  Ax— Ax  and  Ay— Ay  are  shown  in  Figs.  IV.2(a) 
and  IV.2(b). 

The  algorithm  ((36)  and  (37)  were  used)  estimates  target  translational 
parameters  in  the  case  of  rotation,  translation,  and  dilation.  The  target  first 
rotates  about  the  origin  and  then  translates.  The  angle  of  rotation,  6,  was 
varied  from  —15  degrees  to  +15  degrees.  The  dilation  parameter,  k,  was  set 
equal  to  unity.  The  exact  translational  parameters,  Ax  and  Ay,  both  were 
set  the  same  as  before.  Figs.  IV.3(a)  and  IV.3(b)  show  exact  and  algorithm 
estimates  of  target  translational  parameters  versus  the  angle  of  rotation.  The 
results  are  quite  good  over  a  range  of  —5  degrees  to  +5  degrees  (see  also 
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Figs.  IV.4(a)  and  IV.4(b)  for  error  versus  the  angle).  The  algorithm  tends 
to  break  down  when  the  perturbations  get  larger.  This  agrees  with  theory 
since  we  only  keep  the  first  order  term  of  Taylor  Series.  Thus,  the  algo¬ 
rithm  is  expected  to  work  well  for  small  perturbations. 

Figs.  IV.5(a)  and  IV.5(b)  show  the  error  versus  number  of  points,  i.e., 
number  of  sampling  points.  The  results  verify  that  as  the  number  of  sam¬ 
pling  points  increases,  the  error  should  tend  to  decrease.  However,  from  the 
graphs  shown,  we  see  that  the  error  at  a  smaller  number  of  sampling  points 
is  less  than  the  one  at  a  bigger  number  of  sampling  points.  This  is  due  to 
the  geometry  of  the  target  itself.  For  the  overall  graph,  however,  the  error 
tends  to  decrease  as  expected. 

The  algorithm  presented  in  this  section  appears  to  be  implementable  and 
temporally  efficient  for  real-time  video  tracking  using  the  new  sensor.  By 
capitalizing  on  successive  frame  difference  temporal  dependence,  the  algorithm 
estimates  target  rotation,  dilation,  and  translation  parameters.  Computer 
simulation  using  the  4x6  rectangle  to  represent  the  target  confirms  the  vali¬ 
dity  of  the  algorithm.  Various  issues  such  as  matrix  inversion  problem, 
error  analysis,  corresponding  point  problem,  etc.,  have  not  yet  been  solved. 
The  matrix  inversion  problem  and  error  analysis  can  be  solved  easily.  For 
example,  we  can  use  a  generalized  inverse  matrix  approach  to  solve  the 
inversion  problem  [6].  However,  the  correspondence  problem,  still  under 
investigation,  is  much  more  difficult  and  other  techniques  for  target  tracking 
will  be  considered. 
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IV.4  A  tracking  algorithm  using  the  intensity  function 

Since  the  corresponding  point  problem  appears  to  be  very  difficult  to 
solve,  a  new  approach  is  used  to  derive  a  tracking  algorithm.  This  approach 
utilizes  the  intensity  function  and  does  not  require  to  have  the  solution  of 
the  corresponding  point  problem.  The  technique  used  here  is  similar  to  that 
of  Netravali  and  Robbins  [7].  The  other  technique  which  also  avoids 
correspondence  problem  is  proposed  by  Stuller  and  Paik  [8].  Their  approach 
is  based  on  the  Kalman  Filter. 

For  the  sake  of  simplicity,  we  will  consider  the  translation  case  only. 
Based  on  the  intensity  function,  we  will  derive  a  simple  recursive  algorithm 
to  estimate  the  displacement  vector  (D).  The  algorithm  seeks  to  minimize  a 
function  of  the  prediction  error  by  iterating  in  a  gradient  or  steepest  descent 
direction  such  that  the  consecutive  estimates  converge  to  an  estimate  of  the 
translation  vector. 

Let  J(xx )  and  J(xx  —  t)  be  the  intensity  values  of  the  two  successive 
frames  as  a  function  of  spatial  location  x  (a  two-dimensional  vector)  and 
time  t.  The  time  between  the  two  frames  is  r.  We  now  define  the  quan¬ 
tity  A/(xi),_1)  as 

A/(x^Di_1)  =  J(xx)~  J(x.-Di~lx  -t)  (41) 

Since 

J(xx)  =  l(x-Dx  -  r) 

J(x+D  x )  =  /(xx  -t)  (42) 

j  J(x+D-D‘-lx)  =  J(x—D’~lX  —  r) 

We  can  rewrite  (41)  as 

I 


A/(X^)i_1)  =  J(XX)  ~  Jtx+D-D*  l.t)  r 

(43) 

=  -(D-D^^V^Cxx)  +  hot 

Now  let  D—Dl~l  be  an  error  at  the  (£—  l)th  frame  (£')•  That  is 

E‘  =  D-D i_1  (44) 

where 

Ei  =  (e‘x  e^Y  (45) 

For  the  i  th  frame,  displacement  estimate  D‘  may  be  obtained  by  linearizing 

the  intensity  function  around  the  displacement  estimate  for  the  (£—  l)th  field. 

Let’s  write  Dl  as 


6'  =  D'"1  +  E'  (46) 

where 

D‘  =  (Axf  A y'Y  (47) 

Rewrite  (43)  as 

A/(x^D‘-1)  %  -£,rV/(x.O  (48) 

The  gradient  J  (v/(x/))  can  be  evaluated  as  follows: 

V/(x/)  =  V/(w/) 

=  TJIilogzX) 

=  V7(Zog(x+/y)/ )  ^) 

_  dI(log(x+jy)x')  QlUog  ( x+jy)X ) 

8*  3y 

By  the  chain  rule,  we  can  write  as 


(50) 


a/  _  a/  ^  .  a7  av 
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Similar  ly, 


&  « 

i 

7(w+Au)  —  7(w) 

,  7(w)  —  7(w— Au) 

3“ 

2 

A  u 

+  Au 

il  « 

1 

7(w+Av)-7(w) 

,  7(w)  —  7(w— Av) 

av 

2 

Av 

+  Av 

K  =  iliii  +  ilii 

3y  Qu  Qy  Qv  ay 

and  the  remaining  partial  derivatives  can  be  evaluated  as 


Qu  _  x 
ax  x2+y2 

iL  =  ~y 

dx  x2+y2 

=  y 

ay  x2+y2 
Qv  _  X 

ay  x2+y2 

Now  we  can  solve  (48)  by  using  the  least  square  estimation  technique, 
rewrite  (48)  as 


A7(x^i_1)  «  -(e'^  +  e^) 

3x  y  3y 

Solve  (54)  for  e‘x  and  e‘7  by  using  the  same  procedure  as  shown  in 
IV.2.1.  The  solutions  are 


where  a,b,c,d.f  and  diff 


e'x 

e‘. 


ac  —  fd 
diff 

bd  —  fc 
diff 


are  defined  below: 


(51) 


(52) 


(53) 


Let’s 


(54) 

section 


(55) 


-160- 


where 


a  =  Zl32i 

*=i 

m 

b  =  I  a2* 

k=l 

c  =  fatA /* 
k- 1 

d  =  1/3*  A/* 

*=i 

/  = 

t=i 

rfi#  =  fcr2*  £/32*  -(I>*/3*)2 

k=l  *=1  t=l 


a  =  -SL 

d* 

0  =  &- 
p  to 

k  —  1 


where  m  Is  the  number  of  sampling  point.  Combine  (46)  and  (55)  and 
obtain 

A£f  =  Ax‘-1  +  e‘x 

,  (58) 

Ay  =  Ay  1  +  e'y 

Notice  that  A/(x.Z)i_1)  is  defined  in  terms  of  two  quantities:  (i)  the  spatial 
location  x  at  which  it  is  evaluated  and  (*0  the  displacement  z5'-1  with 
which  it  is  evaluated.  Obviously,  wc  do  not  need  to  know  what  point 
corresponds  to  what  point  in  order  to  evaluate  A/(xi?i-1).  However,  we 
have  to  choose  an  initial  estimate  of  D  (i.e.;  3°)  to  start  the  iterative  pro¬ 
cess.  The  consecutive  estimates  should  converge  to  an  estimate  of  the  trans¬ 
lation  vector.  At  this  point  in  time,  neither  a  proof  of  convergence  nor  the 
performance  of  the  algorithm  above  have  yet  been  demonstrated.  Both  sub¬ 
jects  are  currently  in  progress. 


IV.5  Conclusion  and  Plans  for  the  future 

In  this  chapter  we  have  developed  algorithms  for  target  tracking  using 
the  new  sensor  for  the  cases  of  translation,  rotation  and  scaling  using  two 
different  techniques: 

a)  Affine  transformations  and  the  least  square  error. 

b)  Intensity  functions  (of  space  amd  time)  and  the  Kalman  filter. 

The  first  technique  is  mathematically  established,  for  small  target  displace¬ 
ments,  but  requires  the  solution  of  the  correspondence  problem,  i.e.  a 
knowledge  of  corresponding  points  in  consecutive  images.  The  second  tech¬ 
nique  avoids  the  correspondence  problem,  but  the  convergence  of  the  algo¬ 
rithm  in  general  cases  has  not  been  established. 

Simple  computer  simulations  using  rectangular  targets  have  shown  that 
the  algorithm  performs  satisfactorily  under  ideal  conditions. 

The  correspondence  problem  for  technique  (a)  and  the  algorithm  conver¬ 
gence  for  technique  (b)  are  nontrivial  research  areas  requiring  further 
significant  work. 

Another  area  of  current  interest  which  needs  to  be  addressed  in  our 
work  is  non  rigid  motion  which  comprises  single  targets  rotating  on  axis 
other  than  the  optical  axis  and  multiple  targets  moving  at  different  speeds. 


DELTA  T  (••tlnattd) 


vv*. 


1.00  6.00  11.00  16.00  21.00  26.00  31.00 

NUMBER  OF  POINTS 


Figure  IV.5(a).  A  horizontal  error  (Ax— Ax)  versus  number  of 
sampling  points  . 
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Figure  IV.5(b).  A  vertical  error  (Ay— Ay)  versus  number  of 
sampling  points 
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CHAPTER  V 


THE  ROLE  OF  MICROSACCADIC  EYE  MOVEMENT 
IN  THE  HUMAN  VISUAL  SYSTEM 

The  purpose  of  this  research  is  to  study  microsaccadic  eye  movement 
and  its  role,  beneficial  or  otherwise,  in  the  human  visual  system.  Although 
the  characteristics  of  microsaccades  are  well  documented,  their  purpose 
remains  a  topic  of  research,  and  it  is  not  within  the  scope  of  this  project  to 
answer  the  question  of  their  purpose  conclusively.  Rather,  in  this  report,  a 
hypothesis  is  drawn  describing  a  possible  purpose  of  microsaccades,  and  sup¬ 
port  of  the  hypothesis  is  offered  in  the  form  of  documentation  from  previous 
research.  The  hypothesis  is  that  microsaccades  serve  to  sweep  visual  stimuli 
across  several  receptors  (cones)  in  the  fovea.  This  frequent  movement  as  the 
eye  attempts  to  focus  on  its  target  may  help  to  compensate  for  inoperative 
or  less  sensitive  receptors.  If  the  hypothesis  proves  sound,  then  the  benefits 
of  emulating  this  type  of  motion,  in  terms  of  improving  fault- tolerance  and 
local  calibration  in  electronic  detection  systems,  is  clear.  Because  the  docu¬ 
mentation  presented  in  this  report  provides  a  reasonably  sound  basis  for  con¬ 
tinuation  of  the  project,  the  next  step,  modelling  of  this  portion  of  the 
visual  system  for  further  study,  and  eventual  possible  implementation  in 
hardware,  will  be  taken. 

Saccades  are  rapid,  jerklike  movements  which  the  eye  uses  to  locate  and 
focus  on  a  target.  Although  the  boundary  between  what  is  termed  saccadic 
and  microsaccadic  movements  is  unclear,  in  general,  movements  that  subtend 
an  arc  of  10  minutes  or  less  across  the  eye’s  surface  are  termed  microsac¬ 
cadic.  These  movements,  occur  naturally  at  a  frequency  of  1-2  per  second, 
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and  they  occur  without  the  perception  of  image  destabilization  [l] 

It  has  been  implied  that  microsaccadic  movements  are  involuntary,  since 
they  occur  during  periods  of  attempted  fixation.  However,  Steinman  [2] 
found  through  subsequent  research  and  experimentation  that  microsaccades 
were  largely  controllable.  He  found  that  when  subjects  were  instructed  to 
fixate  on  a  target,  moving  their  eyes  as  little  as  possible,  they  were  able  to 
suppress  microsaccades  by  approximately  a  factor  of  4  [2].  In  further 
research  performed  by  Haddad  and  Steinman  [3]  it  was  found  that  in  the 
presence  of  visible  target,  subjects  could  voluntarily  make  microsaccades  in 
the  desired  direction,  and  that  when  spontaneous  movements  did  occur,  that 
subjects  were  aware  of  them.  These  findings  were  significant  because  they 
tended  to  contradict  the  idea  that  microsaccades  might  be  myocardial  "noise" 
[4],  or  that  they  occurred  strictly  in  response  to  drift,  and  to  support  the 
idea  that  they  were  part  of  a  more  complex  function  of  the  human  visual 
system. 

A  more  pronounced  relationship  between  saccadic  and  microsaccadic  eye 
movement  is  evident  in  the  work  of  Zuber  and  Stark  [5,6].  Zuber  studied 
the  velocity-amplitude  relationship  for  saccadic  movements  ranging  in  size 
from  1  to  35  degrees,  and  for  microsaccadic  movements  ranging  from  1  to 
30  minutes  of  arc.  Two  observations  were  made  in  these  experiments.  The 
first  is  that,  with  saturation  at  higher  amplitudes,  the  maximum  velocity  of 
microsaccades  increased  as  function  of  amplitude  of  movement.  The  other, 
perhaps  more  significant  observation,  in  terms  of  supporting  the  original 
hypothesis,  is  that  when  the  data  describing  the  velocity-amplitude  relation¬ 
ship  of  microsaccadic  movement  was  extrapolated  directly  onto  a  similar 


curve  describing  the  behavior  of  saccadic  movement,  the  curve  remained  con¬ 
tinuous  [5].  This  finding  supported  the  idea  that  saccadic  and  microsaccadic 
movement,  both  voluntary  and  spontaneous  were  produced  by  a  common 
physiological  system. 

Further  support  of  the  common  origin  of  saccadic  and  microsaccadic 
movement  was  found  in  the  results  of  the  Van  Gisbergen  [7].  He  made 
observations  concerning  the  velocity-amplitude  relationship  for  saccadic  and 
microsaccadic  movement  that  paralleled  those  made  by  Zuber  and  Stark. 
Van  Gisbergen  went  beyond  this  initial  observation  and,  through  his  research 
and  experimentation  with  rhesus  monkeys,  provided  evidence  that  a  control 
system,  involving  burst  neurons  in  the  pontomedullary  reticular  formation, 
and  motoneurons  in  the  abducens  nucleus,  existed  with  the  visual  system  to 
produce  saccadic  and  microsaccadic  movement.  He  trained  the  monkeys  to 
follow  jumping  visual  targets:  the  monkeys  produced  saccades  in  the  range 
2-20  degrees  and  microsaccades  in  the  range  12-30  minutes.  He  measured 
action  potentials  from  both  burst  neurons  and  motoneurons,  during  each  eye 
movement  by  the  monkeys.  He  found  evidence  that  both  saccades  and 
microsaccades  were  generated  by  burst  neurons.  He  also  found  evidence  to 
suggest  that  the  burst  neuron  discharge  rate  was  directly  related  to  motor 
error,  i.e.,  the  difference  between  the  eye’s  position  at  any  instant,  and  the 
eye’s  desired  position,  determined  from  within  a  higher  visual  center.  He 
developed  a  model  for  a  visual  control  system,  whereby  burst  neurons  gen¬ 
erated  saccades  in  response  to  motor  error  by  driving  motoneurons  in  push- 
pull  by  ipsilateral  and  contralateral  burst  cells. 
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This  research  provides  more  evidence  that  saccades  and  microsaccades 
have  a  common  origin,  which  again  tends  to  negate  the  theory  that  microsac¬ 
cades  are  tin  unwanted  byproduct  of  the  visual  system,  or  that  they  serve 
no  useful  purpose  [1,4].  However,  these  observations  also  tend  to  imply 
that  both  saccadic  and  microsaccadic  movement  share  a  common  function, 
which  has  been  generally  shown  not  to  be  the  case.  The  function  of  sac¬ 
cadic  movements  is  well  defined.  They  are  required  for  target  detection, 
retinal  slip  compensation,  and  repolarization  of  sensory  neurons  in  the  fovea 
[8].  However,  movements  of  a  velocity  lower  than  that  in  naturally  occur¬ 
ring  microsaccades  are  necessary  to  perform  these  functions.  It  is  therefore 
assumed  that,  despite  evidence  of  a  common  physiological  origin,  and  the 
probability  of  overlapping  functions,  that  microsaccades  serve  visual  functions 
that  are  unique. 

Research  and  experimentation  into  the  relationship  between  microsaccades 
and  binocular  rivalry  may  have  yielded  one  unique  function  of  microsac¬ 
cades.  Howard  Sabrin  [9]  investigated  the  effect  of  visual  stimuli  which 
cause  binocular  rivalry,  on  the  Incidence  of  microsaccadic  movement.  Binocu¬ 
lar  rivalry  occurs  when  an  observer  is  presented  with  stimuli  that  cannot  be 
fused  into  one  stable  image.  The  result  is  the  alternating  dominance  of  one 
image  over  the  other.  Sabrin  found  that  microsaccades  increased  by  approxi¬ 
mately  50%  when  measured  during  binocular  rivalry.  The  level  of  microsac¬ 
cadic  activity  was  found  to  increase  at  the  beginning  of  the  suppression 
interval,  and  then,  as  the  eye  under  observation  again  became  dominant,  to 
decrease  to  a  level  approximately  equal  to  that  seen  during  normal  viewing 
conditions.  Further  experimentation  showed  that  the  suppressed  eye,  not  the 


dominant  eye,  was  responsible  for  the  increase  in  microsaccadic  activity  [10]. 

Because  visual  thresholds  for  the  suppressed  eye  increase  by  .5  log  unit 
[11],  the  visual  control  system  may  interpret  the  suppression  interval  as  a 
loss  of  the  visual  target,  and  respond  with  increased  microsaccadic  movement. 
As  microsaccades  provide  information  on  a  neural  level,  the  motor  error  sig¬ 
nal  to  the  oculomotor  system,  and  the  resultant  microsaccadic  movements 
could  decrease  [9]. 

Sabrin  [9]  continued  his  experimentation  in  this  area  in  1983.  He  simu¬ 
lated  microsaccadic  movement  in  periods  of  suppression  during  binocular 
rivalry  to  determine  whether  or  not  microsaccades  actually  facilitated  domi¬ 
nance  of  the  suppressed  stimulas.  He  found  that  the  simulated  movements 
(8.25  minutes,  0-6/sec)  caused  dominance  in  the  suppressed  eye  to  increase. 
Also  significant  was  his  finding  that  the  shift  from  suppression  to  dominance 
was  facilitated  optimally  when  the  emulated  microsaccades  were  of  the  same 
frequency  as  those  which  occur  naturally  (1-2/sec). 

The  results  of  Sabrin’s  experimentation  are  in  accordance  with  Van 
Gisbergen’s  model  of  the  oculomotor  control  system.  Sabrin’s  results  also 
lend  support  to  the  original  hypothesis,  since  they  imply  that  microsaccades 
facilitate  the  passing  of  visual  information  to  the  brain,  despite  the  increased 
visual  threshold  (lower  sensitivity  of  receptors)  in  the  suppressed  eye. 

The  work  of  Armington  [12]  provides  strong  support  for  the  project 
hypothesis.  He  investigated  the  relationship  between  the  amplitude  of  micro¬ 
saccadic  movement  and  visual  response,  by  comparing  microsaccade  lengths 
(generally  <10  minutes)  to  the  visually  evoked  cortical  potentials  (VECP) 
that  accompanied  microsaccades.  The  results  of  his  experiments  showed  a 


linear  relationship  between  microsaccade  length  and  the  level  of  visual 
response.  These  findings  suggest  that  visual  response  was,  at  least  in  part, 
produced  by  sweeping  visual  stimuli  across  several  receptors  using  microsac- 
cadic  movement.  Armington  introduced  the  concept  of  additivity  when  inter¬ 
preting  his  results,  suggesting  that  electrical  activity  measured  in  the  VECP 
was  produced  by  stimulating  separate  receptor  units  and  adding  the  responses 
to  produce  a  total  response.  He  used  this  concept,  along  with  saccade  arc 
length  and  cone  size  to  calculate  am  approximate  reaction  potential  on  a  per 
receptor  basis.  Armington’s  observations  and  conclusions  are  in  accordance 
with  the  other  work  presented  thus  far,  which  supports  the  idea  of  a  useful, 
unique  purpose  for  microsaccades  in  the  human  visual  system. 

The  final  supporting  docunv  station  also  lends  credence  to  the  idea  that 
microsaccades  may  help  to  compensate  for  inoperative  or  insensitive  receptors, 
by  passing  visual  stimuli  over  several  receptors.  Zihl  [5]  trained  patients 
with  varying  degrees  of  cerebral  blindness  caused  by  retinal  scotoma  to  make 
controlled  saccadic  movements,  and  in  doing  so,  increased  the  size  of  their 
visual  fields.  The  majority  of  participating  patients  had  had  a  visual  field 
defect  for  less  than  one  year,  and  no  patient  had  experienced  any  spontane¬ 
ous  recovery  of  visual  field  during  that  time.  Through  Zihl’s  training,  the 
patients  learned  to  make  saccades  in  the  affected  area,  and  to  increase  their 
visual  fields.  Zihl  found  that  the  success  of  the  therapy  was  significantly 
greater  when  the  gradient  of  light  sensitivity  between  the  healthy  area  and 
the  scotoma  was  shallow,  than  when  it  was  steep.  He  also  found  that  light 
stimulas  was  critical  for  visual  field  enlargement,  and  that  with  progress,  the 
radient  of  light  sensitivity  between  the  healthy  and  affected  areas  became 


steeper  [5].  These  findings  are  significant  because  they  seem  to  indicate  a 
direct  causal  relationship  between  saccadic  movement  and  increased  visual 
response,  in  areas  with  a  scattering  of  inoperative  receptors.  These  results  do 
not  extend  to  microsaccadic  movement;  they  are  described  here  because  they 
support  the  project  hypothesis  directly,  and  because  there  is  no  evidence 
available  to  suggest  that  similar  therapeutic  results  could  not  be  obtained 
using  microsaccadic  movement. 

There  is  documentation  available  which  maintains  that  microsaccades 
serve  no  useful  purpose  in  the  human  visual  system.  The  primary  criterion 
for  this  assumption  is  that  microsaccades  decrease  in  frequency  during  obser¬ 
vational  tasks  requiring  high  visual  acuity  [l].  However,  the  decrease  in 
microsaccades  during  high-acuity  tasks  is  expected,  if  the  control  system 
modelled  by  Van  Gisbergen  is  valid.  Following  the  model,  it  is  logical  for 
microsaccades  to  decrease  as  the  oculomotor  error  approaches  zero,  that  is, 
just  as  the  eye  fixates  directly  on  its  target  [7].  It  is  apparent  that  those 
researchers  who  have  concluded  that  microsaccades  are  useless  have  done  so 
because  they  have  been  unable  to  determine  a  valid  purpose  for  them,  that 
is,  a  purpose  that  is  not  shared  with  the  larger  saccades. 

The  work  which  does  not  support  the  original  hypothesis  is  not  to  be 
discounted.  However,  there  exists  ample  support  within  this  report  of  the 
usefulness  of  microsaccadic  movement  in  the  human  visual  system.  The 
direct  relationship  between  saccades  and  microsaccades  in  terms  of  origin, 
velocity-amplitude  characteristics,  and  amplitude-response  characteristics  has 
been  established.  A  unique  purpose  of  microsaccades,  that  of  sending  visual 
information  to  the  brain  during  periods  of  receptor  insensitivity  (binocular 


suppression)  has  been  suggested  and  supported.  A  direct  relationship  between 
the  number  of  receptors  activated  in  a  microsaccadic  movement  and  the  level 
of  visual  response  evoked  has  been  established.  Finally,  evidence  that  con¬ 
trolled  saccadic  movements  increase  the  visual  fields  of  patients  with  areas  of 
inoperative  receptors  has  been  produced.  Although  none  of  the  documenta¬ 
tion  presented  here  may  be  considered  conclusive,  in  terms  of  validating  the 
original  hypothesis,  as  a  cohesive  unit,  the  work  presented  provides  a  sound 
basis  for  the  modelling  of  emulated  microsaccadic  activity  in  an  electronic 
detection  system,  and  for  testing  the  hypothesis  with  original  research. 
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APPENDIX  A.1 


LIST  OF  PROGRAMS  USED  IN  CHAPTER  I 


All  processing  was  done  on  a  VAX  11-750  minicomputer  with 
an  AP-10A-1  Avalon  attached  processor,  a  Colorado  Video 
frame  grabber  and  digitizer  and  a  Lexidata  color  graphics 


system. 


c  ************************************************************************ 
c  * 

c  *  Program  to  generate  Leroy  File  to  plot  sensor  design 
c  *  consisting  of  concentric  circles  and  radial  lines, 

c  *  which  gives  the  distorted  rectangle  element  shape, 

c  * 

c  ************************************************************************ 


Real  r,s,t,u,v,e,f,l 

real  radius(lOO),  thetad(lOO) 

integer  a,  b 


c  First  enter  the  size  of  the  array 

c  Number  of  circles(rings) 

print*, ’Enter  the  number  of  rings’ 

read*,m 

c  Number  of  lines 

print*, 'Enter  the  number  of  elements  per  ring’ 

read*,n 

c  Exponential  spacing 

print*, ’Enter  exponential  spacing  constant’ 

read*,e 

r=e**m 

c  Now  must  create  the  Leroy  File 

write(2,21) 
write(l,21) 

21  formatC ’.clear’) 
u=—1.6*r 
v=1.6*r 

t— 1.2*r 
s=1.2*r 

write(l,22)  u,t,v,s 

22  formatC’. map  0,f  10.2,’,’, f  10.2,’)  C’,f  10.2,’,’, f  10.2,’)’) 
write(2,23) 

23  formatC’. map  C-0.6,-0.2)  C  1.6, 1.2)’) 

writeC2,24) 

24  formatC’.draw  (0,0)  (1,0)  {thick=0.03}’) 

write(2,27) 

27  formatC’.draw  (0,0)  (0,1)  {thick=0.03}’) 

do  10  a-l,n 

thetad(a)=(a*360/n) 


write(l,25)  r,thetad(a) 

formatC. lline  (0,0)  length=’,fl0.2,’  angle=’,fl0.2) 

l=real(a)/real(n) 

write(2,26)  1,1 

format( ’.draw  (0,\fl0.8,’)  (l,’fl0.8’)’) 
continue 
do  20  b=l,m 

radius(b)=  e**b 
write(l,35)  radius(b) 

formatO. circle  (0,0)  radius=’,fl0.2,’  narcs=100’) 

f=real(b)/real(m) 

write(2,36)  f,f 

format(’.draw  e,fl0.8,’,0)  (\fl0.8,\l)’) 
continue 
write(2,40) 

format(’.to  (1.5,1. 1)  cmode=8’) 
write(l,41)  r,r 

format(’.to  (’, f  10.2, ’,’,f  10.2,’)  cmode=8’) 
write(l,42)  m,n,e 
write(2,42)  m,n,e 
format(i2,’,’,i2,’,’,f4.2) 

This  file  is  now  readable  by  Leroy 


S’ 


c  ^t*********************************************************************** 

Q  **** 

c  ****  Program  to  generate  the  log  spiral  vision  sensor 
c  ****  structure  for  circular  elements. 

c  **** 

c  ************************************************************************ 
integer  n,m,o 

real  a,  alpha(200),  radius(lOO) 
real  pi,  k,  max,  r(100),x  ,y,l 
real  lbx,  lby,  ubx,  uby 
real  lmx,lmy,umx,umy 
real  zl,z2 
real  rad 

pi=3.14l6 


c  Set  variables  from  input. 

print*, ’Enter  the  number  of  elements  per  ring.' 
read*,n 

print*, ’Enter  the  number  of  rings’ 
read*,m 

print*, ’Enter  percentage  overlap’ 
read*,o 

c  Calculate  angular  spacing. 

a-real(pi/n) 

do  1  i-l,2*n 

alpha(i)»real(i*a) 

1  continue 

call  finder(n.rad) 

c  Calculate  the  spacing  of  the  rings. 

l-.01*o 

k-rad 

do  2  i=»l,m 

r(i)=k**i 

radius(i)=((l+l)**.5)*(k**i)*sin(a) 

2  continue 


max=r(m) 


c  Create  leroy  file. 


write(2,10) 

write(l,10) 

10  formatC’. clear’) 

c  Set  proper  map  size. 

lbx—  1.6*max 

ubx=»1.6*max 

lby— 1.2*max 

uby-1.2*max 

Imx— .6*  1 . 732*(m- 1  )+2 

umx-1.6*1.732*(m-l)+2 

lmy— .2*2*n 

umy-1.2*2*n 

write(2,ll)  lmx,lmy,umx,umy 
write(l.ll)  lbx,lby,ubx,uby 

11  formatC’.map  (*,f  10.2,’.’/ 10.2,’)  (\f  10.2,’,’, f  10.2,’)’) 

13  formatC ’.circle  C’.f  10.2,’,’, f  10.2,’)  radius-’, f  10.2,’ 

&  narcs-100’) 


c  Calculate  coordinates  of  centers. 


do  5  i-l,2*n 

if((real(i)/2).eq.(int(realCi)/2)))  then 
do  3  j-l,m/2 

x=r(2*j)*cos(alpha(i)) 
y=r(2*j)*sin(alpha(i)) 
write(l,13)  x,y,radius(2*j) 

3  continue 
else 

do  4  j-l,m/2 

x=r(2*j-l)*cos(alpha(i)) 
y  «r(2*j- 1  )*sln(alpha(i)) 
write(l,13)  x,y,radius(2*j-l) 

4  continue 
end  if 

5  continue 


do  20  i=l,n 

do  21  j-l,m/2 

x-1.732*(2*j-l)+l 

y-2*i 

write(2,13)  x,y,(l+l)**.5 


21  continue 

do  22  j=l,m/2 

x-1.732*(2*j-2)+l 

y-2*i-l 

write(2,13)  x,y,(l+l)**.5 

22  continue 
20  continue 

zl=1.5*1.732*(m-l)+2 

z2=l.l*2*n 

write(2,14)  zl,z2 
write(l,14)  max, max 

14  formatC’.to  (\f  10.2,’, ’,f  10.2,’)  cmode-8’) 
write(2,15)  n,m,o 

writeCl,15)  n,m,o 

15  format(i2,7,i2,7,i2) 

write(2,16)  1.732*(m-l)+2 

16  formatC’.draw  (0,0)  (\f  10.2, ’,0)  {thick=0.03}’) 
write(2,17)  real(2*n) 

17  formatC’.draw  (0,0)  (0,’,f  10.2,’)  {thick=0.03}’) 


c  ********************************************************************* 

Q  **** 

C  ****  SUBROUTINE  TO  FIND  THE  ROOTS  FOR  THE  CIRCULAR 
c  ****  ELEMENT  CASE 

c  **** 

c  ********************************************************************* 


subroutine  finder(n,rad) 
integer  n.iflag 

real  alpha.pi.a.b.xtol.error.fa.fm.xm 

real  rad 


pi=3.141592 

alpha=real(pi/n) 

c  f(x)=alpha-x+asin(l-sin(x)) 

a=pi/6 

b=pi/4 

xtol=.00001 

fa=alpha-a+asin(  l-sin(a)) 
f b=alpha-b+asin(  l-sin(b)) 
if  (fa*fb.gt.O.)  then 
iflag=-l 
print  601,a,b 

601  form atC 'SAME  SIGN  AT  2  ENDPOINTS’, 2f  15.7) 
goto  100 

end  if 

error-abs(b-a) 

6  error-error/2 

if  (error.lt.xtol)  then 
goto  100 

end  if 
xm=(a+b)/2 

if  (xm+error.eq.xm)  then 
iflag= 1 

print  602, a, b 

602  formatC ’LIMIT  REACHED’, 2fl5.7) 
goto  100 

end  if 

fm=alpha-xm+asin(  l-sin(xm)) 
if  (fa*fm.gt.0.)  then 


a-xm 

fa=fm 

else 

b=xm 

end  if 
goto  6 

100  print*, ’OK  SO  FAR'.fa.fb.fm.a.b.xm 

rad=sin(a)/(  l-sin(a)) 
print*, rad 

return 

end 


c  jf^tt***************************************************************** 

c  ****  PROGRAM  TO  SIMULATE  THE  LOG  SPIRAL  STRUCTURE 
c  ****  CONSISTING  OF  RECTANGULAR  ELEMENTS,  ALSO 
c  ****  CAN  BE  THOUGHT  OF  AS  CONCENTRIC  CIRCLES  AND 
c  ****  RADIAL  LINES. 

c  tt******************************************************************** 


c  DECLARATIONS 


integer 

n,  m 

real 

e,  maxrad,  scale 

real 

radius(lOO) 

integer 

nrows,  ncols,  file 

integer*2 

temp(-256:256, -256:256) 

integer 

p,stackil(5000),stackjl(5000) 

real 

numavel,numave2,numave3,numave4,slopeCl00) 

integer 

ave  1  ,a  ve2,ave3  ,ave4 

integer 

xmax,xmin,ymax,ymin 

integer*2 

compClOO.lOO) 

integer 

V 

common 

n,m, temp, comp 

c  USER  SELECTABLE  SENSOR  CHARACTERISTICS  m,n,e 

print*,  ’Enter  the  desired  number  of  elements  per  ring’ 
read*,  n 

print*,  ’Enter  the  desired  number  of  rings’ 

read*,  m 

m=m+l 


print*,  ’Enter  the  desired  exponential  spacing  constant’ 
read*,  e 

maxrad  =  e**m 
scale  -  256/maxrad 

c  NOW  MUST  CALCULATE  THE  PROPER  RADII, 
do  1  i=I,m 


radius(i)  =  scale*(e**i) 


1 


continue 


do  100  i=l,n/4 

slope(i)=tan((i-l)*2*3.14l6/n) 

100  continue 

c  NOW  TO  CREATE  THE  IMAGE, 
call  rdhead(nrows,ncols,file) 
do  2  i=-256,ncols-256 

call  rdcol(temp(-256,i),nrows,  file) 

2  continue 

call  c’oseflCfile) 

c  MASK  OFF  THE  FOVEA  AND  OUTER  PERIPHERY. 

call  mask(  radius(m),  radius(l)  ) 
c  NOW  WE  CREATE  THE  PIXEL  FITTED  SIMULATION, 
do  20  i=l,m-l 

do  10  j=l,n/4 
if  (j.eq.Cn/4))  then 
v=i 

call  last(  radius(i),  radius(i+l),  slope(j),  v  ) 
goto  20 
end  if 

call  isoC  radius(i),  radius(i+l),  slope(j),  slope(j+l), 
&  xmax,  xmin,  ymax,  ymin  ) 

p=0 

numavel=0 

numave2=0 

numave3=0 

numave4=0 

avel=0 

ave2=0 

ave3=0 


ave4-0  ySr} 


do  50  k=ymax,ymin,-l 


do  40  l=xmin,xmax 


if  (((k**2+l**2).gt.(radius(i)**2)).and. 
(Ck**2+l**2).lt.(radius(i+l)**2)))  then 

if  (((k).gt.(l*slope(j))).and. 

C(k).lt.(l*slope(j+l))))  then 

p=p+l 

stackil(p)=k 

stackjl(p)=l 

numavel=numavel+temp(k,l) 

numave2=-numave2+temp(k,-l) 

numave3=numave3+temp(-k,-l) 

numave4=numave4+temp(-k,l) 

end  if 

end  if 

continue 

continue 

if  Cp.eq.O)  then 

print*, ’Stopped  due  to  p=0  at’,i,j 
print*,  xmax,xmin,ymax,ymin 
goto  10 


end  if 

avel=  int(numavel/p) 
ave2=  int(numave2/p) 
ave3=  int(numave3/p) 
ave4=  int(numave4/p) 

comp(j,0-avel 

comp(n/2-(j-l),i)=ave2 

comp(j+n/2,i)=ave3 

comp(n-(j-l),i)=ave4 


do  60  k=p,l,-l 


tem  p(  stac  ki  1  ( k )  .stack  j  1  ( k  )  )=a  v  e  1 
temp(stackil(k),-stackjl(k))=ave2 
tem  pC-stacki  1  (  k),-stack  j  1  (  k  ))=a  ve3 
temp(-stackil(k),stackjl(k))=ave4 

60  continue 

10  continue 

20  continue 

c  NOW  TO  WRITE  THE  FILE  BACK 
call  wrhead(nrows,ncols,file) 
do  5  i=-256,ncols-256 

call  wrcol(temp(-256,i),nrows,  file) 

5  continue 

c  NOW  TO  CREATE  THE  MAPPED  IMAGE, 
call  spread 


end 


****************************************************************** 

****  SUBROUTINE  TO  ISOLATE  ONE  POSSIBLE  ELEMENT’S 
****  PIXELS  TO  AVOID  MASSIVE  AMOUNTS  OF  WASTED 
****  COMPUTER  TIME. 

****************************************************************** 


subroutine  iso(r  1  ,r2,m  1 1m2,xmax,xmin,y max.ymin) 

integer  xmax,xmin,ymax,ymin 
real  rl,r2,ml,m2,xl,x2,xla,x2a 

real  yl,y2,y  la,y2a 


xl=rl/((l+ml**2)**.5) 

x2=r2/((l+ml**2)**.5) 

xla=rl/((l+m2**2)**.5) 

x2a-r2/((l+m2**2)**5) 

yl=xl*ml 
y2=x2*m  1 
yla=xla*m2 
y2a=x2a*m2 


xmax=int(max(xl,x2,xla,x2a)) 
xmin=int(min(xl,x2,xla,x2a)) 
ymax=int(max(yl,y2,yla,y2a)) 
y  min=int(min(y  1  ,y2,y  la,y2a)) 

return 


c  I************************************************************************ 

c  ****  SUBROUTINE  TO  CALCULATE  THE  PROPER  STUFF  FOR  THE 
c  ****  LAST  ELEMENT  IN  EACH  QUADRANT  IN  EACH  ROW 

c  I*#********####*###***##**#********#*****#*******#**********************# 


subroutine  last(  rl,  r2,  slope,  v  ) 


integer*2 

temp(-256:256, -256:256 ) 

real 

rl,  r2,  slope 

real 

numavel,  numave2,  numave3,  numave4 

integer 

xmax,  xmin,  ymax,  ymin 

integer 

avel,  ave2,  ave3,  ave4,  p 

integer 

stacki(5000),stackj(5000) 

integer 

n,  v,  a,  b 

integer*2 

comp(100,100) 

common 

n,m, temp, comp 

ymax=  int(r2) 

ymin=  int(rl/((l+slope**2)**.5)) 
xmin=  0 

xmax=  int(r2/((l+slope**2)**.5)) 


p=0 

numavel=0 

numave2=0 

numave3=0 

numave4=0 

avel=0 

ave2=0 

ave3=0 

ave4=0 

do  2  i=ymin,ymax 

do  I  j=xmin,xmax 

if  (((i**2+j**2).gt.(r  1**2)). and. 

%  (Ci**2+j**2).lt.(r2**2)))  then 

if  (i.gt.(j*ml))  then 


p=p+l 

stacki(p)=i 

stackjtp)=j 


numavcl=numavcl+tern  p(i.j) 
numave2=numave2+tem  pli.-j) 


numave3=numave3+temp(-i,-j) 

numave4=numave4+temp(-i,j) 


end  if 
end  if 
continue 
continue 

avel=int(numavel/p) 
ave2=int(numave2/p) 
ave3=int(numave3/p) 
a  ve4=int(numave4/ p) 

a=int(n/4) 

b=int(3*n/4) 

comp(a,v)=avel 
comp(a+ 1  ,v)=ave2 
comp(b,v)=ave3 
comp(  b+ 1 ,  v)=ave4 

do  3  i— p,  1,-1 

temp(stacki(i),stackj(i))=avel 

temp(stacki(i),-stackj(i))=ave2 

ternp(-stacki(i),-stackj(i))=ave3 

temp(-stacki(i),stackj(i)}-=ave4 

continue 


return 


************************************************************************** 


****  PROGRAM  TO  SIMULATE  THE  LOG  SPIRAL  SENSOR 
****  CONSISTING  OF  CIRCULAR  ELEMENTS 

:M******************«***************************************************** 


integer*2 

temp(-256:256, -256:256) 

integer*2 

comp(100,100) 

integer 

n,m,nrows,ncols,file,k,l,aveval,p 

real 

rmax.rmin, alpha,  rad, ave, angle, r, radius 

real 

scale  maxrad.offset 

integer 

xstack(  1 5000  ),y  stack!  15000), x,y 

integer 

xmax,xmin,ymax,ymin 

common 

n,m, temp, comp 

print*, ’ENTER  THE  DESIRED  NUMBER  OF  ELEMENTS  PER  RING’ 
read*,n 

print*, ’ENTER  THE  DESIRED  NUMBER  OF  RINGS’ 
read*,m 

call  rdhead(nrows,ncols,file) 

do  1  i=-256,ncols-256 

call  rdcol(temp(-256,i),nrows,file) 
l  continue 

call  closefl(file) 

alpha=real(3. 14 1592/n) 

call  &nder(n,rad) 

maxrad=(rad**m)*(  l+sin(alpha)) 

scale=256./maxrad 

rmax=256. 

rmin=scale*(  l-sin(alpha)) 

call  mask(  rmax.rmin  ) 

do  5  i=l,m 

radius=sca  lc*(  rad**i ) 

r=radius*sin(alpha) 

ofTset=0 


n  «*"u» 


vXy 

k  “JV* 

v.v. 


if  ((int(real(i)/2)).eq.(real(i)/2))  then 
offset=alpha 

end  if 
do  4  j— l,n 

angle=2*  j*alpha+o£F  set 

call  isolCradius.angle.r.xmax.xmin.ymax.ymin.x.y) 

p=0 

ave=0 

aveval=0 

do  3  k=xmin,xmax 

do  2  l=ymin,ymax 

if  ((((k-x)**2)4<(l-y)**2)).le.(r**2))  then 
p=p+l 

xstack(p)=k 
ystack(p)=l 
ave=ave  +  temp(k,l) 

end  if 

2  continue 

3  continue 

if  (p.eq.O)  then 

printVstopped  due  to  p=0  at’,i,j 
print*, x,y,xmax,xmin,ymax,ymin 
goto  4 

end  if 

aveval=int(ave/p) 
comp(j,i)=aveval 
do  10  k-l,p 

temp(xstack(k),ystack(k))=aveval 


A 

f, 


*  '»  ■  1  "  «r*  •  »»  -  -»  '  ■ 


I 


V 


V 


IV 


10  continue 

4  continue 

5  continue 

call  wrhead(n,m,file) 

do  100  i=l,m 

call  wrcol(comp(l,i),n,file) 
100  continue 


call  send 
call  map() 

call  wrhead(nrows,ncols,file) 
do  6  i=-256,ncols-256 

call  wrcol(temp( -256, 0.nrows, file) 
6  continue 
end 


******************************************************************* 

**** 


*♦**  SUBROUTINE  TO  ISOLATE  THE  ELEMENTS 

****  IN  THE  CIRCULAR  ELEMENT  CASE 

*«** 

******************************************************************* 

subroutine  isolC  radius, angle, r,xmax,xmin,ymax,ymin,x,y  ) 

real  r, angle, radius.xt.yt 
integerxmax,xmin,ymax,ymin,x,y 

xt=radius*cos((3.141592/2)+angle) 

yt=radius*sin((3.141592/2)+angle) 

x=int(xt) 

y=int(yt) 

xmax**int(xt+r) 

xmin=4nt(xt-r) 

ymax=int(yt+r) 

ymin=int(yt-r) 


return 


********************************************************************** 

**** 


**** 

**** 

**** 

**** 


SUBROUTINE  TO  MAP  THE  SIMULATION  INTO  THE 
COMPUTATIONAL  PLANE  FOR  THE  CIRCULAR 
ELEMENT  CASE 


********************************************************************** 


subroutine  mapO 


integer*2 

integer*2 

integer 

integer 

integer*2 

common 


temp(-256:256, -256:256) 
comp(lOO.lOO) 
n,m,nrows,ncols,&le 
k,l,r,x,y,  offset 
maplane(512,512) 

n.m.temp.comp 


nrows=512 

ncols=512 

r=int(min((5 12/(2*n+ 1  )),(5 12/(2+ 1 .73205*(  m- 1 ))))) 
do  4  i=l,m 

offset=0 

if  ((int(real(i)/2)).eq.(reaI(i)/2))  then 
offset=r 


end  if 

y=r+int((i-l)*1.73205*r) 
do  3  j-l,n 

x=513-(r+(j-l)*2*r+offset) 
do  2  k=x-r,x+r 

do  1  l=y-r,y+r 

if  ((C(k-x)**2)+((l-y)**2)).le.(r**2))  then 
maplanc(k,l)=comp(j,i) 


f  1 


end  if 


continue 


continue 

continue 

continue 

call  wrheadCnrows.ncols.file) 
do  7  i=l,ncols 

call  wrcol(maplaneC  1  ,i),nrows,file) 
continue 


return 


************************************************************************** 


c 

c  ****  SUBROUTINE  TO  MASK  OFF  THE  FOVEA  AND  PERIPHERY 
c  ****  OF  THE  IMAGE  THAT  WILL  NOT  BE  USED. 

c  m************************************************************************ 

subroutine  mask(  rmax,  rmin) 

integer*2  temp( -256:256, -256:256) 

real  rmax, rmin 

integer*2  comp(100,100) 

common  n,m,temp,comp 


do  2  i=0,256 

do  1  j=0,256 


if  (((i**2+j**2).ge.(rmax**2)).or.((i**2+j**2).le. 
&  (rmin**2)))  then 

temp(i,j)=0 

temp(i,-j)=0 

temp(-i,j)=0 

temp(-i,-j)=0 

end  if 

1  continue 

2  continue 


return 


c  ********************************************************************* 

Q  **** 

c  ****  SUBROUTINE  TO  FIND  THE  ROOTS  FOR  THE  CIRCULAR 
c  ****  ELEMENT  CASE 

Q  **** 

c  ********************************************************************* 


subroutine  hnder(n,rad) 
integer  n.iflag 

real  alpha,pi,a,b,xtoI,error,fa,fm,xm 

real  rad 


pi=3.14l592 

alpha=real(pi/n) 

c  f(x)=alpha-x+asin(l-sin(x)) 

a=pi/6 

b=pi/4 

xtol=.00001 

fa=alpha-a+asin(  l-sin(a)) 
fb=alpha-b+asin(  l-sin(b)) 
if  (fa*fb.gt.O.)  then 
iflag=—  1 
print  60I,a.b 

601  formatC’SAME  SIGN  AT  2  ENDPOINTS’, 2fl5.7) 
goto  100 

end  if 

error=abs(b-a) 

6  error=error/2 

if  (error.lt.xtol)  then 
goto  100 

end  if 
xm=(a+b)/2 

if  (xm+error.eq.xm)  then 
iflag=l 

print  602, a, b 

602  formatC ’LIMIT  REACHED’, 2f  15.7) 
goto  100 

end  if 

fm»alpha-xm+asin(  l-sin(xm)) 
if  (fa*fm.gt.0.)  then 


V  wy-*y 


t u.t* r Jm  -w 7T? tf  ■' *'•’ 


y  •  i.» 


c  **************************************************************** 
c  ***** 

C  *****  SUBROUTINE  TO  WRITE  OUT  MAPPING 
c  *****  INFORMATION  TO  BE  USED  WITH 
c  *****  EDGE  DETECTION  OPERATOR 

£  ***** 

C  **************************************************************** 


subroutine  send 

integer*2  temp(-256:256, -256:256) 
integer*2  comp(  100,100) 

integer  n,m 


common 

write(l,lO)  n 
write(l.lO)  m 


n,m, temp, comp 


do  2  i=l,m 

do  1  j=l,n 

write(l.lO)  comp(j,i) 


1 


continue 


2  continue 

10  format(ilO) 


return 

end 


■7~r 


c'. 


/  -'a' 


program  hedge 

This  program  simulates  edge  detection  for  human  PVS. 

It  generates  the  edge  data  using  Laplacian-Gaussian 
function,  and  gives  an  average  value  for  every  sampling  point. 

inte£er*2  f(512  512) 

integers  ximg(’l50,250),xedge(  150,250) 

integer*2  lm(300),ln(300) 

integer*2  ir(150) 

integer  rows, cols 

real  rz(150) 

character*40  filename 

common  lm,ln 
common  /bl/  f 
common  /b2/  ximg.xedge 

open(3,file=’testdata’) 
rows=512 
cols=512 
call  numl 
call  num2 
5  write(6,10) 

write(6,20) 
write(6,30) 
write(6,40) 
write(6,50) 
write(6,60) 
write(6,70) 
write(6,80) 

10  formatC/, 'Your  options  are:  ’) 

20  formatC  l=Create  an  image’) 

30  formatC  2=Input  an  image  from  camera’) 

40  formatC  3=Input  the  parameters  for  the  RF  of  PV’) 

50  formatC  4=Image  operation’) 

60  formatC’  5=Edge  operation’) 

70  formatC’  6=quit’) 

80  formatC/, ’Selection?  ’,$) 

readC5,*)  imenu 

go  toC  100,200,300,400,500,9999)  imenu 
go  to  5 

100  call  squareCrows.cols) 
go  to  5 

200  call  inputim 
go  to  5 

300  call  paramet(ir,rz,nrl  ,nr2,ne,thetar) 
go  to  5 

400  write(6,410) 

410  formatC//, ’What  is  the  name  of  file:  ’,$) 


read(5  ,*)filename 
open(  1  ,file=filename) 
call  imgop(ir,rz,nrl,ne,thetar) 
go  to  5 

500  write(6,510) 

510  format(//, 'What  is  the  name  of  file:  ’,$) 

read(5,*)filename 
open(2,file=filename) 
call  edgeop(ir,rz,nr2,ne,thetar) 
go  to  5 
9999  stop 
end 


subroutine  square(rows.cols) 

c  Creat  an  binary  image. 

integer*2  f(512,512) 
integer  rows,  cols 
common  /bl/  f 

do  1  i=l,rows 
do  2  j=l,cols 

if(i  .ge.  150  .and.  i  .le.  350)  then 
ifCj  .ge.  150  .and.  j  .le.  350)  then 
f(i,j)=200 
else 

fCi,j)=125 

endif 

else 

f(i,j)=125 

endif 

2  continue 
1  continue 
return 
end 


subroutine  inputim 

c  Input  an  image  from  a  camera. 

integer*2  f (5 1 2,5 1 2) 
integer*2  col(512) 
integer  fp 


common  /bl/  f 


call  rdhead(nrow,ncol,fp) 
do  1  j=*l,ncol 

call  rdcol(col,nrow,fp) 
do  2  i=l,nrow 
f(i,j)=col(i) 

2  continue 

1  continue 

return 
end 


subroutine  paramet(ir,rz,nrl  ,nr2,ne,tbetar) 

c  It  gives  the  number  of  elements  per  ring,  the  number 

c  of  rings  and  their  coordinates. 

integer*2  ir(150) 
real  rz(150) 

integer  wl,  w 

writeC6,l) 

1  format(/, ’Please  input  the  smallest  diameter  (integer  value)  of  the 
+  central  region  of  the  overlapping  receptive  held,  wl’) 

read(5,*)  wl 
write(6,2)  wl 

2  format(  lx, ’wl=  ’,il) 
write(6,3) 

3  formate/, ’Please  input  the  smallest  integer  value  of  the  eccentric 
+  ity,  ir(  1 )’) 

read(5,*)  ir(l) 
write(6,4)  ir(l) 

4  format( lx, ’ir(l)-  ’,i2) 
write(6,5) 

5  formate/, ’Please  input  the  overlapping  factor,  of’) 
read(5,*)  of 

write(6,6)  of 

6  formate  lx, ’of-  ’,fl0.5) 
pi-3.14159 
r-float(ir(l)) 
rz(l)=wl/2. 
xrz=rz(l) 
rzn=(l.-of)*rz(l) 
rn-pi/asin(rzn/r) 
ne=int(rn+0.5) 
thetar=pi/ne 

a-(tan(thetar))**2.+  l./cosethetar) 

i-i 

9  if(eir(i)+rz(i))  .le.  256.)  then 


if((ir(i)+4.5*rz(i))  .le.  256.)  then 
nr2=i 
endif 

write(6,10)  i,  rz(i),xrz,  i,  ir(i),r 

10  format(/,’Radius  rz(’,i2,’)-,,f7.2,2x,f7.2,5x,’Eccen.  irC’,i2,’) 

+  i3,2x,f8.2) 

r-r*(a+(a**2.-l.)**0.5) 
xrz=(  r  *sin(  thetar  )  )/( 1  .-of  ) 
w=int(xrz*2.+0.5  ) 
i«i+l 

ir(i)=int(r+0.5) 
rz(i)=w/2. 
go  to  9 
endif 
nrl=i-l 
write(6,7)  ne 

7  format(/, ’Number  of  elements  per  ring,  ne=  i3) 
write(6,8)  thetar 

8  format(/,  ’thetar=  ’,fl0.5) 
writee6,ll)  nrl 

11  formate/, ’Number  of  rings  for  image,  nrl=  ’,i2) 
writee6,12)  nr2 

12  formate/, ’Number  of  rings  for  edge,  nr2=  ’,i2) 
end 


subroutine  imgopeir.rz, nr, ne, thetar) 

It  generates  an  average  value  at  every  sampling  point 
for  the  original  image. 

integer*2  fe512,512) 

integer*2  ximge  150,250),  xedgee  150,250) 

integer^  Ime300),lne300) 

integer*2  ire  150) 

real  rzei50) 

common  lm.ln 
common  /bl/  f 
common  /b2/  ximg,  xedge 
do  1  i-l,nr 

id=interz(i)+0.5)-interzei)) 

if e  id  .eq.  0)  then 

call  ifitte(i,ir(i),rzei),ne, thetar) 
else 

call  ifittoei,irei),rz(i),ne,thetar) 
endif 
1  continue 
return 
end 


subroutine  edgeop(ir,rz,nr,ne,thetar) 


It  generates  the  edge  data  using  the  Laplacian-Gaussian 
function. 

integer*2  f(512,512) 

integer*2  ximg(  150,250),  xedge(  150,250) 

integer*2  lm(300),  ln(300) 

integer*2  ir(150) 

real  rz(150) 

real  w(300) 

common  lm,  In 
common  /bl/  f 
common  /b2/  ximg,  xedge 

thetae=2.*thetar 
do  3  1-1, nr 
p=rz(i)**2. 
irz-int(rz(i)*4.5)+l 
nw=irz+l 
w(  1 )— 0. 
do  10  il-2,nw 

w(il)=((il-1.5)**2.)*exp(-(il-1.5)**2./p) 
continue 
do  11  i2=2,nw 

w(i2-l)=w(i2)-w(i2-l) 
continue 
do  4  j=l,ne 

pt=(  j- 1  )*thetae+(  1 1  )**(  i+ 1 ))/ 2  ,*thetar 
xp=256+ir(i)*cos(pt) 
yp-256-ir(i)*sin(pt) 
nx=int(xp+0.5) 
ny=int(y  p+0.5) 
t=fCnx,ny)*w(l) 
do  5  ik=2,irz 
s=0. 

d-ik-0.5 

m-ik-1 

n=0 

s-s+fCnx+m,ny)+f(nx-m,ny)+f(nx,ny+m)+f(nx,ny-m) 

if(m  .eq.  0)  go  to  8 

n=n+l 

ds=m**2.+n**2. 
r2=d**2. 
rl=(d-l.)**2. 
ifCds  .ge.  rl)  then 
if(ds  .It.  r2)  then 

s-s-i-f(nx+m,ny+n)+f(nx-m.ny+n)+f(nx+m,ny-n) 

+f(nx-m,ny-n) 


m=m-l 
n-n-2 
go  to  6 
endif 
else 

go  to  7 
endif 

t=t+s*w(ik)/lm(ik) 

continue 

if Ct  .gt.  -0.1  .and.  t  .It.  0.1)  then 
xedge(i,j)=0 
else 

if(t  .gt.  0)  then 
xedge(i,j)=int(t+l) 
else 

xedgeCi,  j)=int(t-l ) 
endif 
endif 

write(2,*)xedge(i,j) 

write(3,*)i,j,t,xedge(i,j) 

continue 

continue 

return 

end 


subroutine  numl 

It  gives  the  total  number  of  pixels  in  a  receptive  field 
of  odd-numbered  diameter. 

integers  lm(300),  ln(300) 


common  lm,  In 
lm(l)-l 

write(6,2)  lm(l) 
format(  lx, ’lm(  1)=  M3) 
do  5  ik=2,100 
1-ik 
lm(l)=0 
d=ik-0.5 
m-ik-1 
n=0 

lm(l)=lm(l)+4 

if  Cm  .eq.  0)  go  to  8 

n=n+l 

ds=»m**2.+n**2. 

r2=d**2. 


subroutine  num2 


It  gives  the  total  number  of  pixels  in  a  receptive  held 
of  even-numbered  diameter. 


integer*2  lm(300),  ln(300) 
common  lm,  In 
ln(l)»5 

write(6,2)  ln(l) 

2  formatC  Ix,’ln(  I)=-  \i3) 
do  5  ik-2,100 
1-ik 
ln(l)=0 
id-ik 
m-ik 
n=0 

ln(l)-ln(l)+4 

6  if(m  .eq.  0)  go  to  8 

7  n=n+l 
mn-m**2+n**2 
nr2=id**2 
nrl=(id-l)**2 
if(mn  .gt.  nrl)  then 

if(mn  .ie.  nr2)  then 
ln(l)=ln(l)+4 
go  to  7 
else 
m=m-l 


i 

■n; 

n=n-2 
go  to  6 
endif 
else 

go  to  7 
endif 

write(6,l)  1,  ln(l) 
format(lx,’ln(’,i3,’)=*  \i5) 
continue 
return 
end 

» 


$ 
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subroutine  ifitte(i,ir,rz,ne,thetar) 


» 

« 


60 

70 


k 


It  gives  an  average  value  for  every  element 
of  even-numbered  diameter. 


integer*2  f(5l2,512) 

integer*2  ximg(  150,250),  xedgeC  150,250) 
integer*2  lm(300),ln(300) 
integer*2  ir 


common  lm.ln 

common  /bl/  f 

common  /b2/  ximg,  xedge 


thetae=2.*thetar 
irz=int(rz) 
do  40  j=»l,ne 

pt=(  j- 1  )*thetae+(  1 1  )**(i+ 1  ))/2.*thetar 

xp=256+ir*cos(pt) 

yp=256-ir*sin(pt) 

nx-int(xp+0.5) 

ny=int(yp+0.5) 

it=f  (nx.ny  )+f(nx+ 1  ,ny  )+f  (nx- 1  ,ny  )+f  (nx,ny+ 1  )+f(nx,ny-l ) 
ft-float(it) 
nt=ln( 1 ) 
do  50  ik=2,irz 
s=0. 

nt=»nt+ln(ik) 

ld«=ik 

m-ik 

n=0 

s=s+f(nx+m,ny)+f(nx-m,ny)+f(nx,ny+m)+f(nx,ny-m) 

if(m  ,eq.  0)  go  to  80 

n=n+l 

mn=m**2+n**2 

nr2=id**2 

nrl=(id-l)**2 


if(mn  .gt.  nrl)  then 
if(mn  .le.  nr2)  then 

s=s+f(nx+m,ny+n)+f(nx-m,ny+n)+f(nx+m,ny-n) 

+f(nx-m,ny-n) 

go  to  70 
else 
m=m-l 
n=n-2 

go  to  60 
sndif 

else 

go  to  70 
endif 
ft=ft+s 
continue 
fav»ft/nt 

ximg(i,j)”int(fav+0.5) 

write(l,*)ximg(i,j) 

continue 

return 


subroutine  ifitto(i,ir,rz,ne,thetar) 


It  gives  an  average  value  for  every  element 
of  odd-numbered  diameter. 

integer*2  f(512,512) 

integer*2  ximg(  150,250),  xedgeC  150,250) 
integer*2  lm(300),  ln(300) 
integer*2  ir 

common  lm,  In 
common  /bl/  f 
common  /b2/  ximg,  xedge 

thetae-2.*thetar 
irz=int(rz)+l 
do  4  j=l,ne 

pt=(  j- 1  )*thetae+(  1  .-(-1  )**(i+ 1  ))/2.*thetar 
xp=256+ir*cos(pt) 
yp=256-ir*sin(pt) 
nx=int(xp+0.5) 
ny=int(yp+0.5) 
ft=Qoat(f(nx,ny)) 
nt-lm(l) 
do  5  ik=2,irz 
s«0. 

nt=»nt+lm(ik) 


d=ik-0.5 

m=ik-l 

n=0 

s=s+f(nx+m,ny)4-f(nx-m,ny)+f(nx,ny+m)+f(nx,ny-m) 

ifCm  .eq.  0)  go  to  8 

n=n+l 

ds=m**2.+n**2. 
r2=d**2. 
rl=(d-l.)**2. 
if(ds  .ge.  rl)  then 
if(ds  .It.  r2)  then 

s=s+f(nx+m,ny+n)+f(nx-m,ny+n)+f(nx+m,ny-n) 
+f(nx-m,ny-n) 
go  to  7 
else 
m=m-l 
n=n-2 
go  to  6 
endif 
else 

go  to  7 
endif 
ft=ft+s 
continue 
fav=ft/nt 

ximg(i,j)=int(fav+0.5) 
writeC  1  ,*)ximg(i,  j) 
continue 
return 
end 


program  hdispedge 


This  program  displays  images  using  the  data 
which  is  generated  by  the  program  of  human  PVS. 

integer*2  h(5 1 2 ,5 1 2  ) 

integer*2  ximg(150,250),xedge(  150, 250), x(  150,250) 

integer*2  ir(  150) 

integer  rows, cols, plane, threshold, level 

real  rz(l50) 

logical  lexon.readimg.readedge 

character*40  filename 

common  /bl/  h 

common  /b2/  ximg,xedge,x 

readimg=.false. 
readedge=. false. 
lexon=.false. 
rows=512 
cols=512 

call  dparamet(ir,rz,nrl,nr2,ne,thetar) 

5  write(6,10) 

write(6,20) 
write(6,30) 
write(6,40) 
writeC6,50) 
write(6,60) 
write(6,70) 
write(6,80) 
write(6,90) 
write(6,ll0) 
write(6,120) 

10  format(/,’Your  options  are:  ’) 

20  formatC  l=Create  an  image’) 

30  formatC  2=Input  an  image  from  camera’) 

40  formate  3=Input  the  parameters  for  the  RF  of  PV’) 

50  format(’  4=Display  the  original  image’) 

60  formate  5=Display  the  circu’ar  fitting  image’) 

70  formatC ’  6=Display  the  operated  image’) 

80  formatC’  7=Display  the  edge’) 

90  formatC’  8=Write  the  image  to  a  file  for  printing’) 
110  formatC’  9=quit’) 

120  formatC/, ’Selection?  ’,$) 

read(5,*)  imenu 

go  to(  100,200,300,400,500,600,700,800,9999)  imenu 
go  to  5 

100  call  square(rows.cols) 
go  to  5 

200  call  inputim 


go  to  5 

300  call  paramet(ir,rz,nrl,nr2,ne,thetar) 
go  to  5 

400  call  display(rows,cols,lexon) 
go  to  5 

500  ifCreadimg  .eq.  .false.)  then 
writeC6,510) 

510  format(//,’Read  the  image  data  file,  filename  is:  ’,$) 
read(5,*)filename 
open(  1  .file-filename) 
call  rdimg(nrl.ne) 
readimg-.true. 
endif 

call  planeparC  plane) 
ifCplane  .eq.  0)  then 

call  fitting(ir,rz,nrl,ne,thetar) 
else 

call  compuplane(nrl.ne) 
endif 

call  display(rows,cols,lexon) 
go  to  5 

600  ifCreadedge  .eq.  .false.)  then 
write(6,605) 

605  formatC//, ’Read  the  edge  data  file,  filename  is:  ’,$) 

read(5,*)filename 
open(2,file=filename) 
call  rdedge(nr2,ne) 
readedge-.true. 
endif 

do  620  i=l,nr2 
do  610  j=-l,ne 

x(i,j)=xedge(i,j)+127 

610  continue 

620  continue 

call  planepar(plane) 
ifCplane  .eq.  0)  then 
do  640  i-1,512 
do  630  j=l  ,5 12 
h(i,j)=127 

630  continue 

640  continue 

call  fovea(ir(l),0) 
call  imgplane(ir,nr2,ne,thetar) 
else 

call  compuplane(nr2,ne) 
endif 

call  display(rows,cols,lexon) 
go  to  5 

700  ifCreadedge  .eq.  .false.)  then 
writeC6,705) 

705  formatC//, ’Read  the  edge  data  file,  filename  is:  ’,$) 

readC5,*)filename 
open(2, file-filename) 


call  rdedge(nr2,ne) 
readedge=.true. 
endlf 

call  zerocross(nr2,ne) 
write(6,7l0) 

710  formatC/, Thresholding  ?  if  Yes,  Please  type  "1".') 

read(5,*)threshold 
if  (threshold  .eq.  l)then 
write(6,720) 

720  formatC  lx, 'Please  input  the  thresholding  level?’) 

read(5,*)level 
call  thresh(nr2,ne, level) 
endif 

call  planepar(plane) 
ifCplane  .eq.  0)  then 
do  740  i=*l,512 
do  730  j=l  ,512 
h(i,j)=0 

730  continue 

740  continue 

call  fovea(ir(l),255) 
call  imgplane(ir,nr2,ne,thetar) 
else 

call  compuplane(nr2,ne) 
endif 

call  display(rows,cols,lexon) 
go  to  5 

800  call  wrim(rows.cols) 
go  to  5 
9999  stop 
end 


subroutine  square(rows.cols) 

c  Creat  an  image. 

integer *2  h(512,512) 
integer  rows,  cols 
common  /bl/  h 

do  1  i=l,rows 
do  2  j=l,cols 

if(i  .ge.  150  .and.  i  .le.  350)  then 
if(j  .ge.  150  .and.  j  .le.  350)  then 
h(i,j)=200 
else 
h(i,j)=125 

endif 

else 


h(i,j)=125 

endif 

continue 

continue 

return 

end 


subroutine  inputim 

Input  an  image  from  a  camera. 

integer*2  h(512,512) 
integer*2  col(512) 
integer  fp 

common  /bl/  h 

call  rdhead(nrow,ncol,fp) 
do  1  j=»l,ncol 

call  rdcol(col,nrow,fp) 
do  2  i=l,nrow 
h(i,j)=col(i) 
continue 
continue 
return 
end 


subroutine  display C Rows, Cols , lexon ) 

Display  the  image  using  Lexidata  device. 

integer*2  h(512,512) 
integer  Rows, Cols, x,y 
integer*2  Row(512) 
logical  lexon 

common  /bl/  h 

if  (.not.  lexon)  then 

call  opdisp(0,0, Rows, Cols) 
lexon=».true. 
endif 

do  1  x=l,Rows 
do  2  y=l,Cols 


if  (h(x,y)  .gt.  255)  then 
Row(y)=255 
else 

if(h(x,y)  .It.  0)  then 
Row(y)=0 
else 

Row(y)=h(x,y) 

endif 

endif 

2  continue 

call  dsput(Row,Cols) 

1  continue 
return 
end 


subroutine  dparamet(ir,rz,nrl,nr2,ne,thetar) 

c  It  gives  the  number  of  elements  per  ring,  the  number 

c  of  rings  and  their  coordinates  for  the  default  input  value. 

integer*2  ir(150) 
real  rz(150) 

integer  wl,  w 

wl=2 

ir(l)=18 

of =0.2 

pi=3.14159 

r=float(ir(l)) 

rz(l)=wl/2. 

xrz=rz(l) 

rzn=(l.-of)*rz(l) 

rn=pi/asin(  rzn/r  ) 

ne=int(rn+0.5) 

thetar=pi/ne 

a=(tan(thetar))**2.+  l./cos(thetar) 

i=l 

9  ifC(ir(i)+rz(i))  .le.  256.)  then 

ifCCirCi)-*-4.5*rzCi))  .le.  256.)  then 
nr2=i 
endif 

write(6,10)  i,  rz(i),xrz,  i,  ir(i),r 

10  format(/, ’Radius  rz(’,i2,’)=’,f7.2,2x,f7.2,5x,’Eccen.  ir(’,i2,’)=’, 

-  i3,2x,f8.2) 

r=r*(a+(a**2.-l.)#*0.5) 
xrz=(r*sin(thetar))/(  l.-of) 
w=int(xrz*2.+0.5) 
i=i+l 

ir(i)=int(r+0.5) 


rz(i)=w/2. 
go  to  9 
endif 
nrl=i-l 
write(6,7)  ne 

7  formatC/.’Number  of  elements  per  ring,  ne=  i3) 
write(6,8)  thetar 

8  formatC/, ’thetar-  ’,fl0.5) 
writeC6,ll)  nrl 

11  formatC/, ’Number  of  rings  for  image,  nrl=  ’,i2) 
write(6,12)  nr2 

12  formatC/, ’Number  of  rings  for  edge,  nr2=  ’,i2) 
end 


subroutine  parametCir.rz, nrl, nr2,ne, thetar) 

It  gives  the  number  of  elements  per  ring,  the  number 
of  rings  and  their  coordinates. 

integer*2  irCl50) 
real  rzQ50) 

integer  wl,  w 

writeC6,l) 

l  formatC/, ’Please  input  the  smallest  diameter  Cinteger  value)  of  the 

+  central  region  of  the  overlapping  receptive  field,  wl’) 
readC5,*)  wl 
writeC6,2)  wl 
l  formatC  lx, ’wl-  ’,il) 
writeC6,3) 

S  formatC/, ’Please  input  the  smallest  integer  value  of  the  eccentric 

+  ity,  irCl)’) 
readCS,*)  irCl) 
writeC6,4)  irCl) 

1  formatC  lx, ’irCl)-  ’,i2) 

writeC6,5) 

5  formatC/, ’Please  input  the  overlapping  factor,  of’) 
readC5,*)  of 

writeC6,6)  of 

6  formatC  lx, ’of-  ’,fl0.5) 
pi=3.14159 
r=floatCirCl)) 
rzCl)=wl/2. 

xrz-rzC 1 ) 

rzn=Cl.-of)*rzCl) 

rn-pi/asinCrzn/r) 

ne=intCrn+0.5) 

thetar=pi/ne 

a-CtanCthetar))**2.+l./cosCthetar) 


9  if((ir(i)+rz(i))  .le.  256.)  then 

if((ir(i)+4.5*rz(i))  .le.  256.)  then 
nr2=i 
endif 

write(6,10)  1,  rz!i),xrz,  i,  ir(i),r 

10  format!/, ’Radius  rz!’,i2,’)=’,f7.2,2x,f7.2,5x,’Eccen.  ir!’,i2,’) 

+  i3,2x,f8.2) 

r=r*!a+!a**2.-l.)**0.5) 
xrz=!r*sin!  thetar))/!  l.-of ) 
w=int(xrz*2.+0.5  ) 
i=i+l 

ir(i)-int(r+0.5) 
rz(i)=w/2. 
go  to  9 
endif 
nrl-i-1 
write(6,7)  ne 

7  format!/, ’Number  of  elements  per  ring,  ne-  ’,  i3) 
write(6,8)  thetar 

8  format(/,’thetar=  ’,fl0.5) 
write(6,ll)  nrl 

11  format!/, ’Number  of  rings  for  image,  nrl=  ’,i2) 
write!6,12)  nr2 

12  format!/, ’Number  of  rings  for  edge,  nr2=  ’,i2) 


end 


subroutine  fitting!ir,rz, nr, ne, thetar) 

It  gives  an  average  value  for  every  pixel  in  an  element. 
integer*2  h!512,512) 

integer*2  ximg!  150,250),  xedge!  150,250),  x!  150,250) 
integer*2  ir!l50) 
real  rz!l50) 

common  /bl/  h 

common  /b2/  ximg,  xedge,  x 

do  3  i— 1 ,512 
do  2  j- 1,5 12 
h!i,j)=0 

2  continue 

3  continue 
do  1  i-l,nr 

id-int!  rz(  i  )+0.5  )-in  t(  rz(  i ) ) 
if!  id  .eq.  0)  then 

call  fitte(i,ir(i),rz!i),ne, thetar) 


call  fitto(i,ir(i),rz(i),ne,thetar) 
endif 
continue 
return 
end 


subroutine  fitte(i,ir,rz,ne,thetar) 

It  gives  an  average  value  for  every  pixel  in  an  element 
of  even-numbered  diameter. 

integer*2  h(512,512) 

integer*2  ximg(  150,250),  xed^eC  150,250),  x(  150,250) 
integer*2  ir 

common  /bl/  h 

common  /b2/  ximg,  xedge,  x 

thetae=2.*thetar 
irz=int(rz) 
do  40  j=«l,ne 

pt-C  j- 1  )*thetae+(  1 1  )**(i+ 1  ))/2.*thetar 
xp-256+ir*cos(  pt) 
y  p-256-ir*sin(  pt) 
nx=int(xp+0.5) 
ny=int(y  p+0.5) 
h(nx,ny)-x(i,j) 
h(nx+ 1  ,ny  )=-=x(i,j) 
h(nx-l,ny)=x(i,j) 
h(nx,ny+l)=x(i,j) 
h(nx,ny-l)=x(i,j) 
do  50  ik=2,irz 
id=ik 
m=ik 
n=0 

h(  nx+m  ,ny  )=x(  i,  j ) 

h(nx-m,ny)=x(i,j) 

h(nx,ny+m)=x(i,j) 

h(nx,ny-m)=x(i,j) 

if(m  .eq.  0)  go  to  50 

n-n+1 

mn-m**2+n**2 
nr2=id**2 
nrl=(id-l)**2 
if(mn  .gt.  nrl)  then 
lf(mn  .le.  nr2)  then 
h(nx+m,ny+n)=x(i,j) 
h(nx-m,ny+n)-x(i,j) 
h(nx+m,ny-n)-x(i,j) 


h(nx-m,ny-n)=x(i,j) 
go  to  70 
else 
m=m-l 
n-n-2 

go  to  60 
endif 

else 

go  to  70 
endif 

50  continue 

40  continue 

return 
end 


subroutine  fitto(i,ir,rz,ne,thetar) 

It  gives  an  average  value  for  every  pixel  in  an  element 
of  odd-number  diameter. 

integer*2  h(512,512) 

integer*2  ximgC  150,250),  xedge(  150,250),  x(  150,250) 
integer*2  ir 

common  /bl/  h 

common  /b2/  ximg,  xedge,  x 

thetae=2.*thetar 
irz=int(rz)+l 
do  4  j=»l,ne 

pt=(  j-1  )*thetae+(  1  .-(-1  )**(i+ 1  ))/2.*thetar 
xp-256+ir*cos(pt) 
y  p=»256-ir*sin(  pt) 
nx=int(xp+0.5) 
ny=int(y  p+0.5) 
h(nx,ny)=x(i,j) 
do  5  ik-2,irz 
d-ik-0.5 
m-ik-1 
n=0 

h(nx+m,ny)=x(i,j) 

h(nx-m,ny)=x(i,j) 

h(nx,ny+m)=x(i,j) 

h(nx,ny-m)=x(i,j) 

if(m  .eq.  0)  go  to  5 

n=n+l 

ds=m**2.+n**2. 

r2=d**2. 

rl-(d-l.)**2. 


if(ds  .It.  r2)  then 
h(nx+m,ny+n)=x(i,j) 
h(nx-m,ny+n)=x(i,j) 
h(nx+m,ny-n)=x(i,j) 
h(nx-m,ny-n)=x(i,j) 
go  to  7 
else 
m=m-l 
n=n-2 
go  to  6 
endif 
else 

go  to  7 
endif 

5  continue 

4  continue 
return 
end 


subroutine  planepar( plane) 

It  prints  the  message, 
integer  plane 
write(6,10) 

10  formatC/, ’Select  the  display  plane’) 
write(6,20) 

20  formatC  lx, ’Type  "  0  "  for  Image  plane’) 

write(6,30) 

30  formatC  lx, ’Type  "  1  "  for  Computational  plane’) 

read(5,*)  plane 
return 
end 


subroutine  imgplaneCir.nr.ne.thetar) 

It  displays  an  image  in  image  plane. 
integer*2  h(512,5I2) 

integers  ximgC  150,250),  xedgeC  150,250),  x(  150,250) 
integer*2  irC 150) 


common  /bl/  h 


common  /b2/  ximg,  xedge,  x 


thetae-2.*thetar 
do  30  i-l,nr 
do  40  j-l,ne 

pt=(  j- 1  )*thetac+(  1 1  )**(i+ 1  ))/2.*thetar 
xp»256+ir(i)*cos(pt) 
yp=256-ir(i)*sin(pt) 
nx«int(xp+0.5) 
ny-int(y  p+0.5) 
h(nx,ny)-x(i,j) 
h(nx+l,ny)-x(i,j) 
h(nx-l,ny)-x(i,j) 
h(nx,ny+l)=x(i,j) 
h(nx,ny-l)-xCi,j) 
continue 
continue 
return 
end 


subroutine  compuplane(nr,ne) 

It  displays  an  image  in  computation  plane. 
integer*2  hC512,512) 

integer*2  ximgC  150,250),  xedgeC  150,250),  x(  150,250) 
integer  xi,  yi,  xl,  x2,  yl,  y2 

common  /bl/  h 

common  /b2/  ximg,  xedge,  x 

do  2  i- 1,512 
do  1  j— 1 ,512 
h(i,j)— 0 
continue 
continue 
i-i 

if(ne  .gt.  84)  then 
lr-1 
ls-2 
else 
lr=3 
ls=5 
endif 
Id— (lr*2) 
yl-lr+1 
y2-nr*ls 
x2=512+ne*ld 
do  32  yi-yl,y2,ls 


xl— 512-CC 1-C- 1  )**i)/2*lr  +  C 1-C— 1  )**(i+ 1  ))/2*(-ld)) 

j=l 

do  31  xi=xl,x2,ld 
h(xi,yi)=x(i,j) 
h(xi+l,yi)=x(i,j) 
h(xi-l,yi)=x(i,j) 
h(xi,yi+l)=x(i,j) 
h(xi,yi-l)=x(i,j) 
do  36  ik=2,lr 
id=ik 
m=ik 
n=0 

h(xi+m,yi)=x(i,j) 
h(xi-m,yi)=x(i,j) 
h(xi,yi+m)=x(i,j) 
h(xi,yi-m)=x(i,j) 
if(m  .eq.  0)  go  to  36 
n-n+1 

mn=m**2+n**2 
nr2=id**2 
nrl=(id-l)**2 
lf(mn  .gt.  nrl)  then 
ifCmn  .le.  nr2)  then 
h(xi+m,yi+n)=x(i,j) 
h(xi-m,yi+n)=x(i,j) 
h(xi+m,yi-n)=x(i,j) 
h(xi-m  ,y  i-n)=x(  i ,  j ) 
go  to  35 
else 

m-m-1 

n=n-2 
go  to  34 
endlf 

else 

go  to  35 
endif 
continue 

H+l 

continue 
i-i+1 
continue 
return 
end 


subroutine  fovea(irl, color) 

It  displays  a  fovea  in  an  image. 
integer*2  h(512,512) 


subroutine  opdisp(xO,yO, Rows, Cols) 

Set  up  the  displaying  parameter  for  Lcxidata. 

integer  Err(2),xO,yO, Rows, Cols 

call  dsopn(3,Err) 
call  dspld(-l) 


call  dscfg(639,479,10) 
call  dschan(255,255,255) 
call  dscslC  10,0,0) 
call  dscer 

call  dslluCO, 0,4095,0) 

call  dsllu(  1024,0, 1279,255) 

call  dsllu(2048.0, 2303, 255) 

call  dsllu(3072, 0,3327, 255) 

call  dslim(xO,yO,xO+Cols-l,yO+Rows-l ) 

return 

end 


subroutine  wrim(nrow,ncol) 

Write  an  image  to  a  file. 

integer*2  hC512,512) 
integer*2  col(512) 
integer  fp 

common  /bl/  h 

call  wrheadCnrow.ncol.fp) 
do  20  j=l,ncol 
do  10  i=l,nrow 
col(i)=h(i,j) 
continue 

call  wrcol(col,nrow,fp) 

continue 

return 

end 


subroutine  thresh(nr,ne, level) 

It  thresholds  an  image. 

integer*2  ximg(150,250),xedge(  150, 250), x(  150,250) 
integer  level 

common  /b2/  ximg.xedge.x 

do  20  i-l,nr 
do  10  j-l,ne 

if  (x(i,j)  .ge.  level)  then 
x(l,j)-255 


else 

x(i,j)=0 

endif 

10  continue 
20  continue 
return 
end 


subroutine  zerocross(nr,ne) 

c  Finding  zerocrossing-points. 

integer*2  ximg(  150,250),  xedge(  150,250),  x(  150,250) 
logical  al,a2,a3,a4,a5,a6,a7 

common  /b2/  ximg,  xedge,  x 

do  20  i=l,nr 
k=(i+l)/2-i/2 
do  10  j=l,ne 

if(xedge(i,j)  .gt.  0)  then 
if(k  .eq.  0)then 

al*xedge(i,j-l)  .It.  0 
a2=xedge(i,j+l)  .It.  0 
a3=xedge(i+l,j)  .It.  0 
a4=xedge(i+l,j+l)  .It.  0 
a5=xedge(i-l,j)  .It.  0 
a6=xedge(i-l,j+l)  .It.  0 
a7-al  .or.  a2  .or.  a3  .or.  a4  .or.  a5  .or.  a6 
if(a7  .eq.  .true.)  then 
x(i,j)=xedge(i,j) 
else 
xCi,j)=0 
endif 
else 

al=xedge(i,j-l)  .It.  0 
a2-xedge(i,j+l)  .It.  0 
a3=xedge(i+l,j-l)  .It.  0 
a4=xedge(i+l,j)  .It.  0 
a5=xedge(i-l,j-l)  .It.  0 
a6=xedge(i-l,j)  .It.  0 

a7=al  .or.  a2  .or.  a3  .or.  a4  .or.  a5  .or.  a6 
if(a7  .eq.  .true.)  then 
x(i,j)=xedge(i,j) 
else 

x(i,j)=0 

endif 

endif 

else 


subroutine  rdimg(nr.ne) 


It  reads  image  data  which  is  generated  by  the  program 
of  human  PVS. 

integer*2  ximg(  150,250), xedge(  150,250),x(  150,250) 

common  /b2/  ximg.xedge.x 

do  20  i=l,nr 
do  10  j=l,ne 

readCl,*)  ximg(i,j) 
x(i,j)=ximg(i,j) 
continue 
continue 
return 
end 


subroutine  rdedge(nr.ne) 

It  reads  edge  data  which  is  generated  by  the  program 
of  human  PVS. 

integer*2  ximg(  150, 250), xedge(  150, 250), x(  150,250) 

common  /b2/  ximg.xedge.x 

do  20  i-l,nr 
do  10  j=l,ne 

read(2,*)  xedge(i.j) 
continue 
continue 
return 
end 


program  nedge 


c  This  program  simulates  three  edge  detection 

c  schemes  for  the  new  sensor. 

integers  f (-20: 120  -20: 1 70), g( -20: 120  -20: 1 70), h(5 1 2,5 12) 

integer*2  op(-20: 120,-20: 170),  edge(-20: 120,-20: 170) 

integer*2  lm(300),  InClOO),  histo(0:255) 

integer  Rows, Cols, level, plane, rzl 

integer  tl,t2,t3,d 

characterMO  filename 

logical  lexon 

common  lm 
common  /bl/  f,  g,  h 
common  /b2/  op,  edge 
common  /b3/  In 

lexon=.false. 

Rows=5 12 
Cols=5l2 
maxgry=255 
rzl=l 
ir  1=18 
of =0.2 

thetar=0.04425 
nr=34 
ne=71 
call  num 
do  2  i=-20,120 
do  1  j=-20,170 
f(i,j)=0 

1  continue 

2  continue 

5  write(6,10) 

write(6,20) 
write(6,30) 
write(6,40) 
write(6,50) 
write(6,60) 
write(6,70) 
write(6,80) 
write(6,90) 
write(6,100) 
write(6,l  10) 
write(6,120) 
write(6,130) 
write(6,140) 
write(6,150) 
write(6,l60) 
write(6,170) 

10  format(//,’  Your  options  are:  ’) 


v'* 


K 

I 


20  format(/,’  l=Create  an  image’) 

30  format(’  2=Input  an  image  from  camera’) 

40  formatC  3=Input  the  parameters’) 

50  formatC  4=Display  the  original  image’) 

60  formatC  5=Display  the  circular  fitting  image’) 

70  formatC  6=Absolute  value  edge  operation’) 

80  formatC’  7=Laplacian  edge  operation’) 

90  formatC’  8=Lap-Gaussian  edge  operation’) 

100  formatC’  9=display  the  operated  image’) 

1 10  formatC’  10=display  the  edge  without  thresholding’) 

120  formatC’  ll=display  the  edge  with  thresholding’) 

130  formatC’  12=write  the  image  to  a  file’) 

140  formatC’  13=Read  an  image  from  Jays  file’) 

150  formatC’  14=Write  the  Jays  image  to  a  file’) 

160  formatC’  15=quit’) 

170  formatC/,’  Selection?  ’,$) 
readC5,*)  imenu 

go  toC200, 250, 300,350, 400, 500, 600, 700, 800, 900, 1000,1 100, 

+  1200,1300,9999)  imenu 

go  to  5 

200  call  square 

go  to  5 

250  call  inputim 

go  to  5 

300  call  paramet(irI,rzl,nr,ne,of,thetar) 
go  to  5 

350  call  displayCRows.Cols.lexon) 
go  to  5 

400  call  operation(irl,rzl,nr,ne,of,thetar) 
call  planepar(plane) 
ifCplane  .eq.  0)  then 

call  imgplaneCirl,rzl,nr,ne,of,thetar) 
else 

call  compuplaneCnr.ne) 
endif 

call  displayCRows.Cols.lexon) 
go  to  5 

500  call  absopCnr.ne.histo) 
go  to  5 

600  call  lapopCnr.ne) 

call  zerocrossCnr.ne.histo) 
go  to  5 

700  writeC6,710) 

710  formatC/, ’Please  input  the  central  region  radius  of  weighting 

+  function,  rz’) 
read(5,*)  rz 
writeC6,720)  rz 
720  formatC  lx, ’rz=  ’,f 7. 1 ) 
call  gusop(nr,ne,rz) 
call  zerocrossCnr.ne.histo) 
go  to  5 

800  do  820  i=l,nr 


do  810  j=l,r.e 

if(op(i,j)  .gt.  0)  then 
g(i,j)=255 
else 

if(op(i,j)  .It.  0)then 
g(i,j)=0 
else 

g(i,j)=127 

endif 

endif 

810  continue 
820  continue 

call  planepar(plane) 
ifCplane  .eq.  0)then 

call  imgplaneCirl,rzl,nr,ne,of,thetar) 
else 

call  compuplane(nr,ne) 
endif 

call  display(Rows,Cols,lexon) 
go  to  5 

900  do  920  i=*l,nr 

do  910  j=l,ne 
gCi,j)=edgeCi,j) 

910  continue 
920  continue 

call  planepar(plane) 
ifCplane  .eq.  0)  then 

call  imgplaneCir  1  ,rzl  ,nr,ne,of  .thetar) 
else 

call  compuplaneCnr.ne) 
endif 

call  display(Rows,Cols,lexon) 
go  to  5 

1000  write(6,1010) 

write(6,1020) 
writeC6,1030) 
writeC6,1040) 
writeC6,1050) 
write(6,1060) 

1010  formatC//,’  Thresholding  Option’) 

1020  formatC’  l=Display  current  histogram’) 

1030  formatC’  2=Interactive  thresholding') 

1040  formatC’  3=d-peak  thresholding’) 

1050  formatC’  4=Return  to  main  menu’) 

1060  formatC/,’  Selection?  ’,$) 
readC5,*)  imenu 
goto(5 100,5200,5300,5)  imenu 
go  to  1000 

5100  call  disphsChisto.maxgry,  100,450, 150) 
go  to  1000 
5200  writeC6,5210) 

5210  formatC//,’  Select  a  Threshold  Level:  ’,$) 


5300 

5310 


read(5,*)  level 
call  thresh(nr,ne, level) 
call  planeparC plane) 
if  (plane  .eq.  0)  then 

call  imgplane(ir  1  ,rz  1  ,nr,ne,of  .thetar) 
else 

call  compuplaneCnr.ne) 
endif 

call  display(Rows,Cols,lexon) 
go  to  1000 
write(6,5310)  maxgry 

format(//,’  Input  a  d  value  between  2  and  \i4,’  :  ’,$) 
read(5,*)  d 

if  CCd  .It.  2)  .or.  (d  .gt.  maxgry))  go  to  5300 
call  dpeak(histo,tl,t2,t3, maxgry ,d) 

if  (tl  .eq.  -1)  then 
write(6,5320) 
else 

write(6,5330)  tl 
if  (t2  .eq.  -1)  then 
write(6,5360) 
else 

write(6,5340)  t2 
if  (t3  .eq.  -1)  then 
write(6,5360) 
else 

write(6,5350)  t3 
endif 
endif 

write(6,5210) 
read(5,*)  level 
call  threshCnr.ne, level) 
call  planeparC  plane) 
if(plane  .eq.  0)  then 

call  imgplane(irl,rzl,nr,ne,of,thetar) 
else 

call  compuplane(nr,ne) 
endif 

call  display(Rows,Cols,lexon) 
endif 

go  to  1000 

formatC//,’  There  are  no  thresholds  for  the  specified  d.’) 
format(//,’  First  threshold  at:  ’i4) 
formatC/,’  Second  threshold  at:  \i4) 
formatC/,’  Third  threshold  at:  ’,i4) 

formatC//,’  There  are  no  more  thresholds  for  the  specified  d.’) 

call  wrimgCRows.Cols) 
go  to  5 
write(6,1210) 

formatC//, ’What  is  the  name  of  file:  ’$) 
readC5,*)filename 


close(l,err=1220) 

open(  1  ,file=filename,err=  1 200) 

call  rdjay(nr,ne) 

go  to  5 

write(6,1310) 

format(//,’What  is  the  filename:  ’,$) 

read(  5 ,  *)fi  lename 

close(2,err-1320) 

open(2  .file-filename, err=  1 300) 

call  writej(nr.ne) 

go  to  5 

stop 


subroutine  absop(nr,ne,histo) 

It  performs  the  absolute  value  method  for  edge  detection. 

integer*2  f(-20: 120 -20:170),  g(-20: 120,-20: 170),  h(5l2,512) 
integer^  op(-20: 120,-20: 170),  edge(-20: 120,-20: 170) 
integer*2  histo(0:255) 
integer  al,a2,a3,a4,a5,a6 
integer  x,  y 

common  /bl/  f,  g,  h 
common  /b2/  op,  edge 


nring=nr 
nelem=ne 
do  100  i=  1,256 
histo(i-l)=0 
continue 
do  3  i=l,nring 
op(i,l)=0 
op(i,nelem)=0 
edge(i,l)=0 
edgeCi,nelem)=0 
continue 
do  4  j-l,nelem 
op(l,j)=0 
op(nring,j)=0 
edged,  j)=0 
edge(nring,j)=0 
continue 
x=nring-l 
y-nelem-1 
do  5  i-2,x 
do  6  j=2,y 
k=(i+l)/2-i/2 


7ML 


a2=f(i,j)-fu,j-l) 
a3=f(i,j)-f(i-l,j) 
a4“f(i,j)-f(i-l,j+l) 
a5=f(i,j)-f(i,j+l) 
a6=f  (i,  j)-f  (i+ 1 ,  j+ 1 ) 

op(i,j)=abs(al)+abs(a2)+abs(a3)+abs(a4)+abs(a5)+abs(a6) 

edge(i,j)=op(i,j) 

else 

al=f(i,j)-f(i+l,j-l) 

a2=f(i,j)-f(i,j-l) 

a3=f(i,j)-f(i-l,j-l) 

a4=f(i,j)-f(i-l,j) 

a5=f(i,j)-f(i,j+l) 

a6=f(i,j)-f(i+l,j) 

op(i,j)=abs(al)+abs(a2)+abs(a3)+abs(a4)+abs(a5)+abs(a6) 

edge(i,j)=op(i,j) 

endif 

histo(edge(i,j))=histo(edge(i,j))+l 

continue 

continue 

return 


subroutine  square 
Create  a  square  image. 

integer^  f(-20:120  -20:170),  g(-20: 120,-20: 170),  h(512,512) 

common  /bl/  f,  g,  h 

do  1  1=1,512 
do  2  j=l,512 

if(i  .ge.  150  .and.  i  .le.  350)  then 
if C j  .ge.  150  .and.  j  .le.  350)  then 
h(i,j)=200 
else 
h(i,j)=125 

endif 

else 

h(i,  j)=  1 25 
endif 
continue 
continue 
return 


subroutine  compuplane(nr.ne) 

It  displays  an  image  in  computation  plane. 
integer*2  lm(300) 

integers  f(-20: 120 -20:170).  g(-20: 120,-20: 170),  hC512,512) 
integer*2  op(-20:120  -20:170),  edgeC-20: 120,-20: 170) 
integer  xi,  yi,  xl,  x2,  yl,  y2 

common  lm 
common  /bl/  f,  g,  h 
common  /b2/  op,  edge 

do  2  1=1,512 
do  1  j-1,512 
h(i,j)=0 
continue 
continue 
i=l 

ifCne  .gt.  84)  then 
lr=l 
ls=2 
else 
lr=3 
ls=5 
endif 
ld=-(lr*2) 
yl=lr+l 
y2=nr*ls 
x2=512+ne*ld 
do  32  yi=yl,y2,ls 

xl=5 12-((  l-(-l  )**i)/2*lr  +  (l-(-l)**Ci+l))/2*(-ld)) 
j=*l 

do  31  xi=xl,x2,ld 
do  36  ik=2,yl 
id=ik-l 
m=ik-l 
n-0 

if(m  .eq.  1  .and.  n  .eq.  0)  then 
h(xi,yi)=g(i,j) 
h(xi+m,yi)=g(i,j) 
h(xi-m,yi)=g(i,j) 
else 

h(xi+m,yi)=g(i,j) 

h(xi-m,yi)=g(i,j) 

endif 

if(m  .eq.  0)  go  to  36 

m-m-1 

n-n+1 

mn-m**2+n**2 

nr2=*id**2 


nrl=(id-l)**2 
if(mn  .gt.  nrl)  then 
if(mn  .le.  nr2)  then 

if(m  .eq.  0  .and.  n  .ne.  0)  then 
h(xi,yi+n)=g(i,j) 
h(xi,yi-n)=g(i,j) 

go  to  36 

else 

h(xi+m,yi+n)=g(i,j) 
h(xi-m,yi+n)=g(i,j) 
h(xi+m,yi-n)=g(i,j) 
h(xi-m,yi-n)=g(i,j) 
go  to  35 

endif 

else 
n=n-2 
go  to  34 
endif 

else 

go  to  35 
endif 
continue 

j-j+1 

continue 

i=i+l 

continue 

return 


subroutine  gusop(nr,ne,rz) 

It  performs  the  Laplacian-Gaussian  function  method  for 
the  edge  detection. 

integer*2  f(-20: 120 -20:170),  gC-20: 120,-20, 170),  h(512,512) 
integer*2  op(-20:120, -20:170),  edgeC-20: 120,-20: 170) 
integer*2  ln(100) 
real  w(50) 

common  /bl/  f,  g,  h 
common  /b2/  op,  edge 
common  /b3/  In 


call  numco 
do  800  i-l,nr 
do  700  j-l,ne 
op(i,i)=0 
edge(i,j)=0 
continue 


continue 
irz=int(4.*rz)+l 
w(  1  )=0. 
do  10  i-l,irz 
rd-i-0.5 

w(i+l)=(rd**2.)*exp(-rd**2./rz**2.) 
continue 
im=irz-l 
do  20  i=l,im 

w(i)=w(i+l)-w(i) 

continue 

pi=3.14159 

nring=nr 

nelem=ne 

do  40  nr=-l,nring,2 
do  30  ne=»l,nelem 
t=f(nr,ne)*w(l) 
j=2 

sl=sin(pi/3.) 
do  1  m«l,im,l 
s=0. 
jd-1 
r=m+0.5 
k=m+l 

s=s+f(nr,ne+m)+f(nr,ne-m) 

tl=jd*sl 

if(tl**2.  .ge.  r**2.)  go  to  9 
n=(jd+l)/2-jd/2 
ifCn  .eq.  0)  then 
jl=0 
else 
jl-1 
endif 

do  2  i-j.jl -1 
ifCn  .eq.  0)  then 
12—1 
else 
12— i-1 
endif 

dj— ( l-(- 1  )**jd)/2*0.5+float(  i2  ) 

d-(tl**2.+dj**2.)**0.5 

dl-r-1. 

if(d  .ge.  dl)  then 
if(d  .It.  r)  then 
ifCn  .ne.  0)  then 

s»s+f(nr+jd,ne-i)+f(nr+jd,ne+(i-l))+f(nr-jd,ne-i)+ 

f(nr-jd,ne+(i-l)) 

else 

if Ci  .eq.  0)  then 

s-s+f(nr+jd,ne)+f(nr-jd,ne) 

else 

s=s+f(nr+jd,ne+i)+f(nr+jd>ne-i)+f(nr-jd,ne+i)+ 

f(nr-jd.ne-i) 


continue 
jd=jd+l 
go  to  3 
j-j+1 

t=t+s*w(k)/ln(k) 

continue 

if Ct  .gt.  -0.01  .and.  t  .It.  0.01)  then 
op(nr,ne)=0 
else 

if  Ct  .gt.  0)  then 
op(nr,ne)=int(t+ 1 ) 
else 

op(nr,ne)=int(t-l) 

endif 

endif 

continue 

continue 

iri=irz+l 

do  400  nr=2,nring,2 
do  300  ne-l.nelem 
t=f(nr,ne)*w(l) 

j=l 

sl=sin(pi/3.) 
do  11  m=l,im,l 
s=0. 

jd-1 

r=m+0.5 

k=m+l 

s=s+f(nr,ne+m)+f(nr,ne-m) 

tl=>jd*sl 

if(tl**2.  .ge.  r**2.)  go  to  99 
do  22  i=j,0,-l 
n=(id+l)/2-jd/2 
d  j=(  1  -(- 1  )**  jd  )/2*0.5+float(i) 
d=(tl**2.+dj**2.)**0.5 
dl«r-l. 

if Cd  .ge.  dl)  then 
if Cd  .It.  r)  then 
if(n  .ne.  0)  then 

s=s+f(nr+jd,ne-i)+f(nr+jd,ne+(i+l))+f(nr-jd,ne-i)+ 

f(nr-jd,ne+(i+l)) 

else 

if Ci  -eq.  0)  then 

s-s+f(nr+jd,ne)+f(nr-jd,ne) 

else 

s=s+f(nr+jd,ne+i)+f(nr+jd,ne-i)+f(nr-jd,ne+i)+ 

f(nr-jd,ne-i) 


continue 
jd-jd+1 
go  to  33 
j-j+1 

t-t+s*w(k)/ln(k) 

continue 

if(t  .gt.  -0>0l  .and.  t  .It.  0.01)  then 
op(nr,ne)«0 
else 

if(t  .gt.  0)  then 
op(nr,ne)=int(t+l) 
else 

op(nr,ne)-int(t-l) 

endif 

endif 

continue 

continue 


subroutine  imgplaneUr  1  ,rz  1  ,nr,ne,of  ,thetar) 
It  displays  an  image  in  image  plane. 


integer^  lm(300) 

integers  fC-20: 120,-20: 170),  g(-20: 120 -20:170),  h(512,512) 
integer*2  op(-20: 120,-20: 170),  edge(-20: 120,-20: 170) 
integer  rz.rzl 


common  1m 
common  /bl/  f,  g,  h 
common  /b2/  op,  edge 

r-floatCirl) 

ir-irl 

rz-rzl 

irz-rz+1 

thetae-2.*thetar 

a-(tan(thetar))**2.+l./cos(thetar) 
do  30  i-l,nr 
do  40  j-l,ne 

pt-(  j- 1  )*  thetae+(  1 .-(- 1  )**(i+ 1  ))/2.*thetar 
xp=256+ir*cos(pt) 
y  p=-256-ir*sin(  pt) 
nx-int(xp+0.5) 
ny-intCyp+0.5) 
do  50  ik-2,irz 
nt-nt+lm(ik-l) 


id-ik-1 

m=ik-l 

n=0 

if(m  .eq.  1  .and.  n  .eq.  0)  then 
h(nx,ny)=g(i,j) 
h(nx+m,ny)=g(i,j) 
h(nx-m,ny)=g(i,j) 
else 

h(nx+m,ny)=g(i,j) 

h(nx-m,ny)=g(i,j) 

endif 

60  if(m  .eq.  0)  go  to  50 

m=m-l 
70  n~n+l 

mn-m**2+n**2 
nr2=id**2 
nrl=(id-l)**2 
ifCmn  .gt.  nrl)  then 
if(mn  .le.  nr2)  then 
if  Cm  .eq.  0  .and.  n  .ne.  0)  then 
h(nx,ny+n)=g(i,j) 
h(nx,ny-n)=g(i,j) 
go  to  50 
else 

h(nx+m,ny+n)=g(i,j) 
h(nx-m,ny+n)=g(i,j) 
h(nx+m,ny-n)=g(i,j) 
h(nx-m,ny-n)=g(i,j) 
go  to  70 
endif 

else 

n=n-2 

go  to  60 
endif 

else 

go  to  70 
endif 

50  continue 

40  continue 

r=r*(a+(a**2.-l.)**0.5) 

ir=int(r+0.5) 

xrz=(  r*sin(  the  tar)  )/( 1  .-of ) 
rz=int(xrz+0.5) 
irz=rz+l 
30  continue 
return 
end 


outine  lanon(nr.ne) 


iMtfi; 


It  performs  the  Laplacian  method  for  edge  detection. 

integer*2  f(-20: 120  -20:170),  g(-20: 120,-20: 170),  h(512,512) 
integers  opC-20: 120,-20: 170),  edge(-20: 120,-20: 170) 
integer  al,a2,a3,a4,a5,a6 
integer  x,  y 

common  /bl/  f,  g,  h 
common  /b2/  op,  edge 

nring=nr 
nelem=ne 
do  3  i=l,nring 
op(i,l)=0 
op(i,nelem)=0 
edge(i,l)=0 
edge(i,nelem)=0 
continue 
do  4  j=l,nelem 
op(l,j)=0 
op(nring,j)=0 
edge(l,j)=0 
edge(nring,j)=0 
continue 
x=nring-l 
y=nelem-l 
do  5  i=*2,x 
do  6  j=2,y 
k=(i+l)/2-i/2 
ifCk  .eq.  0)  then 
al-f(i,j)-f(i+l,j) 
a2=f(i,j)-f(i,j-l) 
a3«f(i,j)-f(i-l,j) 
a4=f(i,j)-f(i-l,j+l) 
a5=f(i,j)-f(i,j+l) 
a6=f(i,j)-fCi+l,j+l) 
op(i.j)=al+a2+a3+a4+a5+a6 

elSal-f(i,j)-f(i+l,j-l) 
a2=f(i,j)-f(i,j-l) 
a3— f  (i,  j)-f  (i— 1 ,  j- 1 ) 
a4-f(i,j)-f(i-l,j) 
a5=f(i,j)-f(i,j+l) 
a6-f(i,j)-f(i+l,j) 
op(i,j)=al+a2+a3+a4+a5+a6 
endif 
continue 
continue 
return 
end 


subroutine  num 


It  gives  the  total  number  of  pixels  for  an  element. 
integer*2  lm(300) 
common  lm 
lm(  1  )=5 

write(6,2)  lm(l) 
formatC  lx, ’lm(  1)=  ’,i3) 
do  5  ik=3,151 
l=ik-l 
lm(l)-0 
id=ik-l 
m=ik-l 
n=0 

if(m  .ne.  0  .and.  n  .eq.  0)  then 
lm(l)=lm(l)+l 
endif 

if (m  .eq.  0)  go  to  8 

m=m-l 

n=n+l 

mn=m**2+n**2 
nr2=id**2 
nrl=(id-l)**2 
ifCmn  .gt.  nrl)  then 
ifCmn  ,le.  nr2)  then 

if(m  .eq.  0  .and.  n  .ne.  0)  then 
lm(l)=lm(l)+l 
go  to  8 
else 

lm(l)=lm(l)+l 
go  to  7 
endif 
else 
n-n-2 
go  to  6 
endif 
else 

go  to  7 
endif 

lm(l)-4*(lm(l)-l) 
write(6,l)  1,  lm(l) 
formatC  lx, 'lm(’,i3,’)-  ’,i5) 
continue 


subroutine  numco 


It  gives  the  total  number  of  elements  in 
Laplacian-Gaussian  function  method. 

integer*2  ln(100) 

common  /b3/  In 

pi=3.14159 

j-1 

sl=sin(pi/3.) 

ln(l)=l 

write(6,4)ln(l) 

4  format(  lx, ’ln(l)=  ’,i3) 
do  1  m=  1,20,1 

jd=l 
r=m+0.5 
k=m+l 
ln(k)=0 
ln(k)=ln(k)+2 
3  do  2  i=-j,0,-l 
tl-jd*sl 

n=C jd+ 1  )/2- jd/2 

if(tl**2.  .ge.  r**2.)  go  to  9 

dj=(  l-(-l  )**jd  )/2*0.5+fioat(i) 

d=(tl**2.+dj**2.)**0.5 

dl-r-1. 

if(d  .ge.  dl)then 
if(d  .It.  r)then 

if(i  .eq.  0  .and.  n  .eq.  0)  then 
ln(kj=ln(k)+2 

elSfn(k)=ln(k)+4 

endif 

endif 

endif 

2  continue 
jd=»jd+l 
go  to  3 
9  j-j+1 

write(6,5)k,ln(k) 

5  format(lx,’ln(,,i2,’)=  ’,13) 

1  continue 


integer*2  lm(300) 

integer*2  f (-20: 120  -20:170),  gC-20: 120  -20:170),  h(512,512) 
integer*2  op(-20: 120  -20: 170),  edge(-20: 120,-20: 170) 
integer  rz.rzl 

common  lm 
common  /bl/  f,  g,  h 
common  /b2/  op,  edge 


r=float(irl) 

ir=irl 

rz=rzl 

irz=rz+l 

thetae=2.*thetar 

a=(tan(thetar))**2.+ 1  ./cos(thetar ) 
do  3  i=l,nr 
do  4  j=l,ne 

pt=(  j- 1  )*thetae+(  1 1  )**(  i+ 1 )  )/2.*thetar 

xp=256+ir*cos(  pt) 

yp=256-ir*sin(pt) 

nx-int(xfH-0.5) 

ny=int(y  p+0.5) 

ft=0. 

nt=0 

do  5  ik=2,irz 
s=0. 

nt=nt+lm(ik-l) 

id=ik-l 

m=ik-l 

n=0 

if(m  .eq.  1  .and,  n  .eq.  0)  then 

s=s+h(nx+m,ny)+h(nx-m,ny)+h(nx,ny) 

else 

s=s+h(nx+m,ny)+h(nx-m,ny) 

endif 

if(m  .eq.  0)  go  to  8 

m-m-1 

n=n+l 

mn-mM2+nM2 
nr2-id**2 
nrl=(id-l)**2 
if(mn  .gt.  nrl)  then 
if(mn  .le.  nr2)  then 

if(m  .eq.  0  .and.  n  .ne.  0)  then 
s=s+h(nx,ny+n)+h(nx,ny-n) 
go  to  8 
else 

s=s+h(nx+m,ny+n)+h(nx-m,ny+n)+h(nx+m,ny-n) 
+h(nx-m,ny-n) 
go  to  7 
endif 
else 
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n=n-2 
go  to  6 
endif 
else 

go  to  7 
endif 
ft=ft+s 
continue 
fav=ft/nt 
f(i,j)=int(fav+0.5) 
g(i,j)=f(i,j) 
continue 
r=r*(a+(a**2.-l 
ir=int(r+0.5) 

xrz=Cr*sin(thetar))/(  1  .-of  ) 
rz=int(xrz+0.5) 
irz=rz+l 
continue 
return 
end 


subroutine  parametCir  1  ,rz  1  ,nr  1  ,ne,of  ,thetar) 

c  It  gives  the  number  of  elements  per  ring,  the  number 

c  of  rings  and  their  coordinates. 

integer*2  rzClOO),  ir(100) 
integer*2  rzl 

write(6,l) 

1  formatC/, ’Please  input  the  smallest  integer  value  of  the  central 
+  region  of  the  overlapping  receptive  field,  rz(l)’) 

read(5,*)  rz(l) 
rzl=>rz(l) 
write(6,2)  rz(l) 

2  formatC  lx,  ’rzCl)=»  ’,il) 
write(6,3) 

3  formatC/, ’Please  input  the  smallest  integer  value  of  the  eccentric 

+  ity,  irCl)’) 

readC5,*)  irCl) 
irl=irCl) 
write(6,4)  ir(l) 

4  formatC  lx, ’ir(l)=-  ’,i2) 
write(6,5) 

5  formatC/, ’Please  input  the  overlapping  factor,  of’) 
readC5,*)  of 

writeC6,6)  of 

6  formatC  lx, ’of =  ’,fl0.5) 
pi=>3. 14159 
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r=float(ir(l)) 

rzn=(l.-of)*rz(l) 

rn=pi/asinCrzn/r) 

ne=int(rn+0.5) 

thetar=pi/ne 

a=(tan(thetar))**2.+l./cos(thetar) 

i=l 

9  if((ir(i)+rz(i))  .le.  256)  then 

if((ir(i)+4*rz(i))  .le.  256)  then 
nr2=i 
endif 

r=r*Ca+Ca**2.-l.)**0.5) 
xrz=(r*sin(thetar))/(  1  .-of  ) 
i=i+l 

ir(i)=int(r+0.5) 
rz(i)=int(xrz+0.5) 
go  to  9 
endif 
nrl=i-l 
write(6,7)  ne 

7  formatC/, ’Number  of  elements  per  ring,  ne=  i3) 
write(6,8)  thetar 

8  formatC/, ’thetar=  ’,fl0.5) 
writeC6,ll)  nrl 

11  formatC/, 'Number  of  rings  for  image,  nrl=  ’,i2) 
write(6,12)  nr2 

12  format(/, ’Number  of  rings  for  edge,  nr2=  ’,i2) 
return 

end 

subroutine  planeparC  plane) 
integer  plane 
write(6,10) 

10  formatC/, ’Select  the  display  plane’) 
write(6,20) 

20  formatC  lx, ’Type  "  0  "  for  Image  plane’) 
write(6,30) 

30  formatC  lx, ’Type  "  1  "  for  Computational  plane’) 
readC5,*)  plane 
return 
end 


subroutine  rdjay(nr.ne) 

It  reads  the  data  from  Jay’s  hie. 

integers  fC-20: 120,-20: 170),  g(-20: 120,-20: 170),  hC512,512) 
integer*2  nr,  ne 


common  /bl/  f,  g,  h 


read(l,*)ne,nr 
write(6,*)nr,ne 
do  20  i=l,nr 
do  10  j=l,ne 
read(l,*)f(i,j) 
g(i,j)=f(l,j) 
continue 
continue 
return 
end 


subroutine  opdisp(xO,yO,Rows,Cols) 

Setup  the  displaying  parameters  for  Lexidata  device. 

integer  Err(2),x0,y0, Rows, Cols 

call  dsopn(3,Err) 

call  dspld(-l) 

call  dscfg(639,479,10) 

call  dschan(255,255,255) 

call  dscsl(  10,0,0) 

call  dscer 

call  dslluCO, 0,4095,0) 

call  dsllu(1024, 0,1279, 255) 

call  dsllu(2048, 0,2303, 255) 

call  dsllu(3072, 0,3327, 255) 

call  dslim(xO,yO,xO+Cols-l,yO+Rows-l) 

return 

end 


subroutine  thresh(nr,ne, level) 

It  thresholds  an  image. 

integers  f(-20:120, -20:170),  g(-20: 120,-20: 170),  h(512,512) 
integers  op( -20:120, -20:170),  edge(-20: 120,-20: 170) 
integer  level 

common  /b  1  /  f,  g,  h 
common  /b2/  op,  edge 

do  20  i-l,nr 
do  10  j-l,ne 

if  Cedge(i.j)  .ge.  level)  then 
g(i.j)=255 


else 

g(i,j)=0 

endif 

continue 

continue 

return 

end 


subroutine  writej(nr.ne) 

Write  the  data  to  Jay’s  file  for  display. 

integers  f(-20: 120,-20, 170),g(-20: 120  -20:170),  h(512,512) 
integer  ne.nr 

common  /bl/  f,  g,  h 

write(2,*)ne,nr 
do  20  i-l,nr 
do  10  j=-l,ne 
write(2,*)g(i,j) 
continue 
continue 
return 
end 


subroutine  wrimg(nrow,ncol) 

It  writes  the  image  to  a  file. 

integer*2  f(-20:120, -20:170),  g(-20:120, -20:170),  h(512,512) 
integer*2  col(512) 
integer  fp 

common  /bl/  f,  g,  h 

call  wrhead(nrow,ncol,fp) 
do  20  j=»l,ncol 
do  10  i=l,nrow 
col(i)=h(i,j) 
continue 

call  wrcol(col,nrow,fp) 

continue 

return 

end 


c 


subroutine  zerocross(nr,ne,histo) 
It  finds  the  zerocrossing-points. 


integers  opC-20: 1 20,-20: 170),  edgeC-20: 120,-20: 170) 
integer*2  histo(0:255) 
logical  bl,b2,b3,b4,b5,b6,b7 

common  /b2/  op,  edge 

do  100  i=  1,256 
histo(i-l)=0 
100  continue 
nring=nr 
nelem=*ne 
do  20  i=l,nring 
k=(i+l)/2-i/2 
do  10  j=*l,nelem 

if(op(i,j)  .gt.  0)  then 
if(k  .eq.  0)then 
bl=op(i+l,j)  .It.  0 
b2=op(i,j-l)  .It.  0 
b3=op(i-l,j)  .It.  0 
b4==op(i-l,j+l)  .It.  0 
b5=op(i,j+l)  .It.  0 
b6=op(i+l,j+l)  .It.  0 

b7=bl  .or.  b2  .or.  b3  .or.  b4  .or.  b5  .or.  b6 
if(b7  .ne.  .true.)  then 
edge(i,j)=0 
else 

edge(i,j)=op(i,j) 

endif 

else 

bl=*=op(i+l,j-l)  .It.  0 
b2=op(i,j-l)  .It.  0 
b3— opCi- 1 , j- 1 )  .It.  0 
b4-op(l-l,j)  .It.  0 
b5-op(i,j+l)  .It.  0 
b6-op(i+l,j)  .It.  0 

b7-bl  .or.  b2  .or.  b3  .or.  b4  .or.  b5  .or.  b6 
if(b7  .ne.  .true.)  then 
edge(i,j)«0 
else 

edge(i,j)=op(i,j) 

endif 

endif 

else 

edge(i,j)=0 

endif 

histo(edge(i,j))=histo(edge(i,j))+l 
10  continue 


subroutine  inputim 

Input  an  image  from  a  camera. 


integer*2  f(-20: 120,-20: 170),  g(-20:120, -20:170),  h(5l2,512) 
integer*2  col(512) 
integer  fp 

common  /bl/  f,  g,  h 

call  rdhead(nrow,ncol,fp) 
do  1  j=l,512 

call  rdcol(col,nrow,fp) 
do  2  1=1,512 
h(i,j)=col(i) 

2  continue 

1  continue 

return 
end 


subroutine  disphs(histo,maxgry,xo,yo,maxy) 

Display  the  histogram  of  an  image. 

integer  histo(0:255),maxgry,xo,yo,maxy 
integer  erase, color, length, gray 
real  scale 
10  write(6,20) 

20  formatC//, ’Input  a  scale  factor  (-1  to  quit);  ’$) 

read(5,*)  scale 
if  (scale  .le.  0)  go  to  999 
do  40  erase- 1,2 

if  (erase  .eq.  1)  then 
color=0 
else 

color-255 

endif 

call  dsvec(xo,yo,xo+gray,yo, color) 
do  30  gray=0,maxgry 
if  (erase  .eq.  1)  then 
length-maxy 


els 

length=histo(gray  )/ sea  le 
If  (length  .gt.  maxy)  length=maxy 
endif 

call  dsvec(xo+gray,yo,xo+gray,yo-length, color) 
continue 
continue 
return 
end 


subroutine  dpeak(histo,tl,t2,t3,maxgry,d) 

It  finds  the  three  suitable  threshold  values  for  an  image, 
real  merit(128),minn 

integer  histo(0:255),t(3),peak(128),peaki(128) 
integer  valley(128),valleyi(128),d,maxgry,k,kmin 
integer  numpeaks, width, gray  ,winmax,jmax 
integer  tl,t2,t3 

do  100  1=1,128 
peak(i)=0 
peaki(i)=0 
valley(i)=0 
valleyi(i)=0 
merit(i)=0 
continue 

k=0 

width=2*d+l 
do  120  i=0,maxgry 
winmax=0 
do  110  j=i-d,i+d 

if  ((j  .It.  0)  .or.  (j  .gt.  255))  then 
gray=0 
else 

gray-histo(j) 

endif 

if  (gray  .ge.  wlnmax)  then 
winmax=gray 
jmax=j 
endif 
continue 

if  (jmax  .eq.  i)  then 
k=k+l 

peak(k)=winmax 

peaki(k)=i 

endif 

continue 


numpeaks=k 


do  130  j=l,numpeaks-l 
valley(j)-100000 
valleyi(j)=0 

do  130  i=peaki(j)+l,peaki(j+l)-l 
if(histoCi)  -le.  valley(j))  then 
valley(j)=histo(i) 
valleyi(j)=i 
endif 
continue 

do  140  j=l,numpeaks-l 

meritCj)=*float(valley(j))/float(min(peak(j),peak(j+l))) 

continue 

ten— i 

t(2)-l 
t(3)=- 1 

if  C(numpeaks-l)  .It.  3)  then 
n-numpeaks-1 
else 
n=3 
endif 

do  145  j=l,n 
minn=l.l 

do  155  k=l,numpeaks-l 

if  (merit(k)  .It.  minn)  then 
minn=merit(k) 
kmin=k 
endif 
continue 

tCj)-valleyi(kmin) 

merit(kmin)=5.0 

continue 

ti-tcn 

t2=t(2) 

t3=t(3) 

return 

end 


subroutine  display(Rows,Cols,lexon) 

Display  an  image. 

integers  f(-20: 120,-20: 1 70),g(-20: 1 20,-20: 1 70),h(5 1 2,5 1 2) 
integer  Rows, Cols, x.y 
integer*2  Row(512) 


logical  lexon 

common  /bl/  f,g,h 

if  (.not.  lexon)  then 

call  opdisp(0,0, Rows, Cols) 
lexon-.true. 
endif 

do  1  x=l,Rows 
do  2  y=l,Cols 

if  (h(x,y)  .It.  0)  then 
Row(y)=0 
else 

if(h(x,y)  .gt.  255)  then 
Row(y)=255 
else 

Row(y)=h(x,y) 

endif 

endif 

continue 

call  dsput(Row.Cols) 
continue 
return 


Subroutine  Zeroer(ncoun, zero, fixed, minpts) 

Calculates  the  optimal  zero  level.  That  is  finds  that  value 
of  zero  which  provides  the  fewest  intersection  points. 

Integer  ncoun,  prevn,  count,  minpts 
Logical  fixed,  teprev 
Real  zero.  pzero(30) 

pzero(O)  =  0 
count  -  count  +  1 

Print  160,  count,  ncoun,  zero 

If  ((count  -gt.  30)  .or.  (abs(zero-pzero(count-l))  .It.  le-8)) 
1  Go  to  11 

pzero(count)  -  zero 

teprev  =*  ((prevn  .eq.  ncoun)  .and.  (ncoun  .ge.  3)) 

If  ((ncoun  .gt.  150)  .or.  teprev)  Then 
fixed  =  .true. 

Goto  10 
Endif 

If  (ncoun  .gt.  3)  Then 

zero  =  zero  -  abs((zero-pzero(count-l))/2.0) 
fixed  =  .false. 

Go  to  10 
Endif 

If  (ncoun  .It.  3)  Then 

zero  =  zero  +  l.l*abs((zero-pzero(count-l))/2.0) 
fixed  -  .false. 

Else 

fixed  =  .true. 

Endif 

prevn  =  ncoun 
Go  to  15 
count  =  0 

minpts  -  int(0.9*minpts) 

Return 

Format  (/,  'Calculating  optimal  zero  value...’) 

Format  ('Pass  ’.i2.i5,gl5.5) 

End 


Subroutine  Writer(x.y.n.k) 

Writes  the  data  in  a  file.  Strictly  for  error  analysis. 

Common  nmax 

Integer  n,  k 

Real  x(nmax),  y(nmax) 

If  (k  .gt.  4)  Then 
Print  110 
Else 

Do  10.  i  ■>  1,  n 

Write(k.lOO)  i.  x(i),  i.  y(i) 

Continue 

Endif 

Return 

Format  0x(\i3.  ’)  -  ’.gl3.6/  yC.i3.‘)  -  \g13.6) 
Format  (  Cannot  write  data  in  files  anymore  ) 

End 


Subroutine  Trnslt(x.y.n) 

Translate  the  data  set. 

Common  k,  nmax 

Real  x(nmax),  y(nmax) 

xtrans  =  0.0 
ytrans  =  0.0 

Print  100 

Read  *,  xtrans,  ytrans 

Do  10,  i  =  l,n 

x(i)  =  x(i)  +  xtrans 
y(i)  =  y(i)  +  ytrans 
Continue 

Write(k.llO)  xtrans,  ytrans 
Return 

Format  ('Enter  the  x,y  translations 
Format  (’The  translations  are:  \2f5.2) 


Subroutine  Sort(x.n.xmin.xmax) 

c  Sorts  the  data  set  and  returns  the  maximum  and  the  minimum  values, 
c 

Common  nmax 
c 

Real  x(nmax),  tempx(lOOO) 
c 

Do  10.  i  =  l.n 
tempx(i)  =  x(i) 

10  Continue 
c 

Do  120  nc  =  2,n 
Do  100  i  =  nc.n 

If  (tempx(i)  .gt.  tempx(nc-l))  Then 
temp  =  tempx(nc-l) 
tempx(nc-l)  =  tempx(i) 
tempx(i)  =  temp 
Endif 

100  Continue 
120  Continue 
c 

xmax  =  tempx(l) 
xmin  =  tempx(n) 
c 

Return 

End 


Subroutine  Setup(xmax.xmin,ymax,ymin,dev.a.b,csiz) 
c  To  setup  screen  parameters  and  draw  the  axes, 
c 

Real  a,b,dev,csiz,xmax,xmin,ymax.ymin,axlenx,axleny 
Real  deltx.delty,xmnpr,xmxpr,ymnpr,ymxpr 
c 

xmnpr  =  xmin  -  0.1*xmax 
ymnpr  =  ymin  -  0.1*ymax 
c 

xmxpr  =  l.l*xmax 
ymxpr  =  l.l*ymax 
c 

Call  plots(dev) 

Call  scrnp(a,b.a.-b) 

Call  paper(xmnpr. xmxpr  .ymnpr. ymxpr) 
c 

axlenx  =  xmax  -  xmin 
axleny  =■  ymax  -  ymin 
deltx  -  0.2*axlenx 
deity  =  0.2*axleny 
c 

Call  axis(xmin.ymin,lh  .-l,axlenx.0.,xmin.deltx.csiz,0.2.0,l) 
Call  axis(xmin.ymin.0h.0.axleny,90..ymin.delty,csiz,0,2,0.l) 
Return 
End 
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Subroutine  Secsrt(x.y,num) 

Sorts  data  by  one  variable  keeping  the  relative  position  constant 
Integer  num,  nc,  i 

Real  x(lOOO),  y(lOOO).  tempi,  tempy 

Do  120  nc  -  2, num 
Do  100  i  —  nc.num 

If  (x(i)  .gt.  x(nc-l))  Then 
tempi  -  x(nc-l) 
x(nc-l)  -  x(i) 
x(i)  =  tempi 

tempy  -  y(nc-l) 
y(nc-l)  =  y(i) 
y(i)  =  tempy 

Endif 

Continue 

Continue 


Subroutine  Rotate(x,y.n) 

To  rotate  the  data  points 

Common  k.  nmax 

Real  i(nmax),  y(nmax).  tempi,  tempy,  pi 

pi  -  3.1415926 

Print  100 
Read  *,  theta 

If  (theta  .gt.  360)  theta  -  theta  -  int(theta/360)*360 
If  (theta  .It.  0)  theta  -  theta  +  int(theta/360)*360 

Write  (k.110)  theta 

theta  -  theta*pi/180. 

Do  10,  i  -  l.n 

tempi  -  x(i)*cos( theta)  -  y(i)*sin(theta) 
tempy  -  y(i)*cos(theta)  +  x(i)*sin(  theta) 
i(i)  -  tempi 
y(i)  -  tempy 
Continue 

Return 

Format  (/ ,  Enter  the  angle  of  rotation  —  >  ’,$) 
Format  ('Angle  of  rotation  -  ',  f6.2) 


Subroutine  Qualgc(tempx.tempy.num) 

The  qualitative  algorithm  to  track  direction  of  transformation 
for  images  which  the  optical  axis. 

**  Still  under  construction  ** 

Character*8  motion(2) 

Integer  num,  nmax,  k.  cntxp,  cntyp,  cntxc.  cntyc 
Real  tempx(6,nmax),  tempy(6.nmax) 

Common  k.  nmax 

cntxp  -  o 
cntxc  -  0 
cntyp  -  0 
cntyc  -  0 
motion(l)  - 
motion(2)  - 

Do  10.  i  -  1.  num 

If  (tempx(k-l.i)  .It.  tempx(k-2.i))  Then 
cntxp  »  cntxp  +  1 
Else 

cntxc  -  cntxc  +  1 
Endif 

If  (tempy(k-l.i)  .It.  tempy(k-2.i))  Then 
cntyp  -  cntyp  +  1 
Else 

cntyc  -  cntyc  +  1 
Endif 
Continue 

If  (cntxp  .gt.  cntxc)  Then 
motion(l)  -  'left' 

Else 

motion(l)  -  right’ 

Endif 

If  (cntyp  .gt.  cntyc)  Then 
motion(2)  -  ‘down’ 

Else 

motion(2)  -  'up' 

Endif 

Do  20,  i  *  1,  2 

If  (motion(i)  .ne.  ")  Print  100.  motion(i) 

Continue 


Return 

Format  ('Moved  ’.  a8) 


cntcx  -  cntcx  +  1 
Endif 

Continue 

If  (minim  .eq.  first)  Goto  60 
first  -  minim 
second  -  maxim 
Goto  10 

If  ((cntcl-cntp2.gt.4).and.(cntpl-cntc2.gt.4))  motion(l)-'right' 
If  ((cntc2-cntpl.gt.4).and.(cntp2-cntcl.gt.4))  motion(2)-’left’ 

If  ((cntc3-cntp4.gt.4).and.(cntp3-cntc4.gt.4))  motion(3)-'up’ 

If  ((cntc4-cntp3.gt.4).and.(cntp4-cntc3.gt.4))  motion(4)-'down‘ 

equal  -  ((cntcl  .eq.  cntp2)  .and.  (cntpl  .eq.  cntc2)  .and. 

(cntc3  .eq.  cntp4)  .and.  (cntp3  .eq.  cntc4)) 

If  (equal  .and.  (cntpx  .It.  cntcx))  motion(5)=*'magnified  right’ 
If  (equal  .and.  (cntpx  .gt.  cntcx))  motion(6)=’reduced  left’ 

Do  70,  i  -  1,  6 

If  (motion(i)  .ne.  "")  Then 
Print  120,  motion(i) 

Write(3,120)  motion(i) 

Endif 

Continue 


Return 

Format  (’Moved  a32) 


Subroutine  Qualg(stcurx.stcury,stprvx.stprvy,nmax  .minim, maxim) 
The  qualitative  algorithm  to  track  direction  of  transformation 
for  images  which  do  not  contain  the  optical  axis. 

**  Still  under  construction  ** 

Character*32  motion(6) 

Integer  cntcl,  cntc2,  cntc3,  cntc4.  cntpl,  cntp2,  cntp3.  cntp4 
Integer  cntcx.  cntpx,  minim,  maxim,  first,  second 
Logical  equal 

Real  stcurx(nmax).  stcury(nmax).  stprvx(nmax),  stprvy(nmax) 

pi  -  3.1415926 
first  -  1 
second  =*  minim 
cntcl  -  0 
cntc2  -  0 
cntc3  -  0 
cntc4  -  0 
cntcx  -  0 
cntpl  -  0 
cntp2  -  0 
cntp3  -  0 
cntp4  -  0 
cntpx  -  0 
Do  5,  i  -  1.  6 
motion(i)  - 
Continue 

Do  50.  i  **  first,  second 

If  (((stcury(i)  .ge.  3*pi/2.)  .and.  (stcury(i)  .le.  2*pi)) 

.or.  ((stcury(i)  .ge.  0.)  .and.  (stcury(i)  .It.  pi/2.))) 
cntcl  -  cntcl  +  1 

If  ((stcury(i)  .ge.  pi/2.)  .and.  (stcury(i)  .It.  3*pi/2.)) 
cntc2  -  cntc2  +  1 

If  ((stprvy(i)  .ge.  pi/2.)  .and.  (stprvy(i)  .It.  3*pi/2.)) 
cntpl  -  cntpl  +  1 

If  ((Cstprvy(i)  .ge.  3*pi/2.)  .and.  (stprvy(i)  .le.  2*pi)) 

.or.  ((stprvy(i)  .ge.  0.)  .and.  (stprvy(i)  .It.  pi/2.))) 
cntp2  -  cntp2  +  1 

If  (Cstcury(i)  .ge.  0.)  .and.  (stcury(i)  .It.  pi)) 
cntc3  -  cntc3  +  1 

If  ((stcury(i)  .ge.  pi)  .and.  (stcury(i)  .It.  2*pi)) 
cntc4  -  cntc4  +  1 

If  ((stprvy(i)  .ge.  pi)  .and.  (stprvy(i)  .It.  2*pi)) 
cntp3  -  cntp3  +  1 

If  ((stprvy(i)  .ge.  0.)  .and.  (stprvy(i)  .It.  pi)) 
cntp4  -  cntp4  +  1 

If  (stcurx(i)  .It.  stprvx(i))  Then 
cntpx  -  cntpx  +  1 


Subroutine  Menu(option.ans  1 ) 

Presents  the  menu 

Character*  1  a  ns.  ansi 
Integer  option 

option  -  0 

Print  100 
Print  110 
Print  120 
Print  125 
Read  140.  ans 

If  (  ans  .eq.  *1*)  option  -  1 

If  (  ans  -eq.  ‘2’)  option  -  2 

If  (  ans  .eq.  ‘3’)  option  -  3 

If  (option  .ne.  0)  Goto  10 

If  (ans  .ne.  'n')  Then 
Print  130 
Read  150.  option 
Else 

option  -  4 
Endif 

If  (ansi  -eq.  ’n’)  Call  Clrscn 
Return 

Format  (/.  ‘Would  you  like  to  do  any  of  the  following?’) 
Format  (*  1.  Magnify  the  figure’) 

Format  ('  2.  Route  the  figure  ’) 

Format  ('  3.  Translate  the  figure:  [y]/n  ’,  $) 

Format  (/.  'Enter  the  option  — >  ’.  $) 

Format  (al) 

Format  (i2) 


95 

c 


Call  Logmap(x.y,n.dev.a,b.csize,xmax) 


Print  180 
Read  120.  reply 
c 

If  (reply  .eq.  'y')  Goto  1 
c 

If  (reply  .eq.  ’c‘)  Then 
n  -  ntem 
Do  20.  i  -  1.  n 
x(i)  =  xtem(i) 
y(i)  =  ytem(i) 

20  Continue 

Goto  95 
Endif 
c 

If  (reply  .eq.  *x*)  Goto  5 
c 

Else 

c 

Print  140 

c 

Endif 

c 

Stop 

100  Format  (a80) 

110  Format  ('  Do  you  want  to  see  the  mapped  figure?  *.$) 

120  Format  (al) 

140  Format  (Tough!!*) 

150  Format  (il) 

160  Format  (/,  "Enter  the  screen  parameters:  *.  $) 

170  Format  ('Enter  the  height  of  the  numbering  characters:  ".$) 
180  Format  ('Do  you  want  to  conduct  another  session?  ’,$) 

200  Format  ('Do  you  want  the  output  on:*,/, 

1  *1)  Tektronix  4014*./. 

2  *2)  Plotter’./, 

3  '  3)  Tektronix  4107’,/, 

4  *  4)  Laser  Printer:  S) 

End 


Program  Main 

Main  program.  Calls  Inputl  and  Logmap. 

Common  nmai 

Character*80  header 
Character*  1  axis,  reply 
Integer  n,  ntem.  dev 

Real  x(lOOO),  y(lOOO),  xtem(lOOO),  ytem(lOOO) 
Real  a.  b.  csize,  xmin,  xmax.  ymin.  ymax 

Call  Clrscn 

Print  200 
Read  150.  dev 

If  (dev  .eq.  3)  Then 
a  -  0.20 
b  -  0.80 
csize  -  .08 
Goto  4 
Endif 

Print  160 
Read  *.  a,  b 
a  -  a/100, 
b  -  b/100. 

Print  170 
Read  *.  csize 

nmax  -  1000 

Call  Input  1  (x ,y .n.xmin .xmax, ymin ,y max .  1  .header ) 
ntem  -  n 
Do  10.  i  ■  1,  n 
xtem(i)  -  x(i) 
ytem(i)  -  y(i) 

Continue 

Call  Setup(xmax  .xmin  .y  max  .ymin  ,dev  ,a,b, csize) 
Call  line(x,y.n.l. 0.0,0 .0) 

Print  100.  header 

Call  Waite 

Call  plot(0..0..999) 

Print  110 
Read  120,  ans 


Call  Clrscn 


Subroutine  Mgnfy(x.y.n) 

To  magnify  the  data  set. 

Common  nmax 

Real  i(nmai),  y(nmax).  factor 

Print  100 
Read  *,  factor 

Do  10.  i  -  1.  n 
x(i)  =  x(i)*f  actor 
y(i)  =  y(i)*factor 
Continue 


Return 

Format  (/.  'Enter  the  magnification  factor 


Call  ImdiffCtempx.tempy.num.xmax.xmin. 

ymax,ymin,dev,a,b.csiz.centre.minchk) 

Call  Waite 
Endif 

Call  plot(0..0.,999) 

Return 

Format  (/.  'Would  you  like  to  do  anything  else?  $) 
Format  (al) 

Format  (/,  ’Performing  the  transformation...'./) 


Endif 


Do  10.  i  —  1,  n 

If  (abs(w(i))  .It.  l.e-6)  w(i)  =■  l.e-6 

x(i)  -  0.5*alog(w(i)**2  +  z(i)**2) 
y(i)  =  atan(z(i)/w(i)) 

If  (w(i)  .It.  0.)  y(i)  »  y(i)  +  pi 

If  (.not.(centre))  Then 

If  (y(i)  .It.  0.)  y(i)  =  y(i)  +  2*pi 
Endif 

Continue 

num  =  i  -  2 

Call  Conver(tempx.x.num) 

Call  Conver(tempy.y.num) 

numim  =  numim  +  1 

If  (ans  .ne.  'n')  Goto  11 

Call  Sort(x.num.xmin.xmax) 

Call  Sort(y.num.ymin.ymax) 

maxy  =  ymax 
miny  *  0.0 
minx  -  0.0 
maxx  =  xmax 

Call  Setup(maxx.minx.maxy,miny.dev,a.b,csiz) 
xpt  = 

ypt  -  y(l) 

minchk  =  (ypt  .eq.  ymin) 

If  (,not.(centre  .or.  minchk))  Call  Secsrt(y.x.num) 

Call  line(x.y.num.l.O.O.k-l.O) 

Call  number(xpt.ypt,.06.0.0,0.-1.0) 

k  -  k  +  1 

Call  Waite 

Print  100 

Read  110.  ans 

If  (ans  .ne.  n‘)  Goto  1 


If  (numim  ,gt.  l)  Then 


Subroutine  Logmap(w,z,n.dev,a.b.csiz.maxx) 

Subroutine  to  do  the  mapping 

Common  k.nmax 

Character*  1  ans 

Integer  option.i.num.k.dev.numim 

Logical  centre.condl  ,cond2.cond3.cond4,minchk 

Real  pi.a.b.csiz.zmin.zmax 

Real  w(nmax).z(nmax).x(1000).y(l000).tempy(6,1000).tempx(6,1000) 
Real  xmax.xmin.ymax.ymin.maxx.minx.maxy.miny.wmin.wmax 

pi  =  3.1415926 
k  =  1 

numim  =  0 
num  =  0 
ans  =  'n' 

****  Initialise  **** 

Do  25.  j  -  1.  6 
Do  24,  i  -  1,  n 
tempx(j.i)  »  0.0 
tempyCj.i)  *  0.0 
Continue 
Continue 

Call  Clrscn 

Call  Menu(option.ans) 

Goto  (5.6, 7.8)  option 

Call  Mgnfy(w.z.n) 
num  =  num  +  1 
Goto  8 

Call  Rotate(w.z,n) 

Goto  8 

Call  Trnslt(w.z,n) 

Print  130 

If  (ans  .ne.  ’n‘)  Goto  81 

Call  Sort(w.n.wmin.wmax) 

Call  Sort(z.n.zmin.zmax) 

condl  =  (zmin  .gt.  0.) 
cond2  =  (zmax  .It.  0.) 
cond3  =>  (wmin  .gt.  0.) 
cond4  ”  (wmax  .It.  0.) 

If  (condl  .or.  cond2  .or.  cond3  .or.  cond4)  Then 
centre  -  .true. 

Else 

centre  -  .false. 


Goto  99 


Print  220 
Goto  90 

Print  210 
Goto  1 

Return 

Format  (/.  ’Do  you  want  to  input  from  the  keyboard  or  a  file?  ',$) 
Format  (Al) 

Format  (/.  ‘Please  input  header  information.’) 

Format  (A80) 

Format  (/.  ‘How  many  data  points  do  you  have?  ',$) 

Format  (12) 

Format  (’Enter  the  data  as  x.  y') 

Format  (’What  file  is  the  data  in?  ’.$) 

Format  (A32) 

Format  (/) 

Format  Cx('.I2.').  y(’.12.  ’)  — >  $) 

Format  (’File  does  not  exist:  please  try  again’) 

Format  ('Not  enough  data  in  the  file:  try  another’) 

End 


c 

c 


Subroutine  Inputl(a.b,n.xmin,xmax.ymin.y  max. nou. header) 
Input  routine.  Reads  data  either  from  the  keyboard  or  a  file. 


V 


c 

c 

c 


c 

c 

c 


c 


c 


c 


10 

c 

c 


c 

c 

1 

c 

c 


c 


15 

c 

c 


Character*l  ans 
Character*32  fname 
Character*80  header 
Real  a(nmax).  b(nmax) 

Common  nmax 

Call  Clrscn 

Print  100 
Read  110,  ans 

If  (ans  .eq.  'k')  Then 

Open  (Unit  «  nou.  File  =  'data.dat',  Status  **  'unknown') 

Print  118 
Read  119,  header 

Print  120 
Read  130,  n 
Write  (nou,*)  n 

Print  140 

Do  10.  i  -  1.  n 
Print  200.  i,  i 
Read  *,  a(i).  b(i) 

Write  (nou.*)  a(i).  b(i) 

Continue 

Close  (Unit  -  nou) 

Call  Sort(a.n.xmin,xmax) 

Call  Sort(b,n.ymin.ymax) 

Else 

Print  150 
Read  160,  fname 

Open  (Unit  -  nou.  File  -  fname.  Status  *»  'old'.  Err  -  80) 

Read  (nou. 119,  Err  -  70)  header 

Read  (nou,*.  Err  -  70)  n,  xmin,  xmax.  ymin.  ymax 

Do  15,  i  —  1,  n 

Read  (nou.*.  Err-70)  a(i).  b(i) 

Continue 

Close  (Unit  -  nou) 


S 

kY 


S 
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If  ((num2  .It.  numl)  .and.  (first  .eq.  minim))  Then 
stprvx(i)  =  stprvx(minim) 
stprvy(i)  =»  stprvy(minim) 

Endif 

If  (mod(i,3)  .eq.  0)  Then 

Call  plot(stprvx(i),stprvy(i),3) 

Call  plot(stcurx(i)^tcury(i),2) 

Endif 

Continue 

If  (first  .eq.  minim)  Goto  97 

first  ■=  minim 
second  =  maxim 

Goto  94 

If  (centre)  Then 

Call  Qualgc(tempx,tempy,num) 

Else 

Call  Qualg(stcurx.stcury.stprvx.stprvy, lOOO.minim.maxim) 
Endif 


Return 

End 


Do  70,  j  -  curr(i),  curr(i+l)  -  1,  stepc 
countl  -  count 1  +  1 
If  (mod(j.num)  .eq.  0)  Then 
jth  -  j 
Else 

jth  -  mod(j,num) 

Endif 

stcurx(countl)  -  tempx(k-l.jth) 
stcury(countl)  -  tempy(k-l.jth) 

Continue 

If  (prev(i)  .gt.  prev(i+l))  Then 

If  (.not.(centre))  prev(i+l)  =  prev(i) 
stepp  =  -1 
Else 

stepp  =»  1 
Endif 

Do  80.  j  =  prev(i).  prev(i+l)  -  1,  stepp 
count2  =  count2  +  1 
If  (mod(j.num)  .eq.  0)  Then 
jth  -  j 
Else 

jth  «  mod(j.num) 

Endif 

stprvx(count2)  -  tempx(k-2,jth) 
stprvy(count2)  -  tempy(k-2,jth) 

Continue 

numl  =  numl  +  abs(curr(i+l)-curr(i)) 
num2  -  num2  +  abs(prev(i+l)-prev(i)) 

Continue 

If  (centre  .or.  minchk)  Goto  65 

Call  Secsrt(stprvy,stprvx.nuni2) 

Call  Secsrt(stcury,stcurx.numl) 

Call  Setup(xmax.O.,ymax,0..dev,a,b.csiz) 

Call  line(stprvx.stprvy,num2. 1.0 .0,0,0) 

Call  line(stcurx.stcury. numl,  1.0 .0,1,0) 

minim  ■  min(numl.num2) 
maxim  -  max(numl,num2) 

first  =  1 
second  =  minim 

Do  95  i  -  first,  second 

If  ((numl  .It.  num2)  .and.  (first  .eq.  minim))  Then 
stcurx(i)  -  stcurx(minim) 
stcury(i)  -  stcury(minim) 

Endif 


Endif 


If  (.not.(fixed))  Goto  5 

chkcnt  **  ncoun-2 
Do  55.  i  -  2,  chkcnt 
ncheck  -  (ncoun  .ge.  3) 
nreduc  -  ((abs(prev(i+l)-prev(i))  .le.  3)  .or. 

1  (abs(curr(i+l)-curr(i))  .le.  3)) 

If  (nreduc  .and.  ncheck)  Then 
ncoun  -  ncoun  -  1 
Do  54.  nucnt  -  i.  ncoun 

prev(nucnt)  -  prev(nucnt+l) 
curr(nucnt)  -  curr(nucnt+l) 

Continue 
Goto  52 
Endif 
Continue 

Do  60.  i  =  1.  ncoun-2 
If  (centre)  Then 

Q1  *>  ((tempx(k-2.prev(i)-2)-tempx(k-2,prev(i))  .It.  0.) 

1  .or.  (tempx(k-2,prev(i))-tempx(k-2,prev(i)+2)  .It.  0.)) 

Q2  -  ((tempy(k-2.prev(i)-2)-tempy(k-2,prev(i))  .It.  0.) 

1  .or.  (tempy(k-2.prev(i))-tempy(k-2.prev(i)+2)  .It.  0.)) 

Q3  -  ((tempx(k-l.curr(i)-2)-tempx(k-l,curr(i))  .It.  0.) 

1  .or.  (tempx(k-l,curr(i))-tempx(k-l,curr(i)+2)  .It.  0.)) 

Q4  =  ((tempy(k-l,curr(i)-2)-tempy(k-l.curr(i))  -It.  0.) 

1  .or.  (tempy(k-l,curr(i))-tempy(k-l,curr(i)+2)  .It.  0.)) 

Q5  =  (prev(i+l)-prev(i)  .gt.  50) 

Q6  =*  (curr(i+l)-curr(i)  .gt.  40) 

If  (((.not.(Ql)  .and.  Q2  .and.  .not.(Q3)  .and.  .not.(Q4)) 

1  .or.  (Q1  .and.  .not.(Q2)  .and.  Q3  .and.  Q4))  .and.  Q5) 

2  Then 

prev(i)  -  prev(i)  +  num 
Endif 

If  (((Ql  .and.  Q2  .and.  Q3  .and.  .not.(Q4))  .or. 

1  (.not.(Ql)  .and.  .not.(Q2)  .and.  .not.(Q3)  .and.  Q4) 

2  .or.  (.not.(Ql)  .and.  Q2  .and.  Q3  .and.  Q4)) 

3  .and.  Q6)  Then 
curr(i)  -  curr(i)  +  num 

Endif 

Endif 

If  (curr(i)  .gt.  curr(i+l))  Then 

If  (.not.(centre))  curr(i+l)  -  curr(i) 
stepc  =  -1 
Else 

stepc  -  1 
Endif 


.  »*«■ 


Subroutine  Imdiff  ( tempx  .tempy  ,num  ,imax  .xmin , 

1  ymax,ymin.dev,a.b.csiz,centre,minchk) 

Finds  the  difference  of  two  images. 

**  Still  under  construction  ** 

Common  k.  nmax 

Integer  curr(lOOO),  prev(lOOO).  ncoun.  countl.  count2 
Integer  chkcnt,  stepp,  stepc,  nucnt,  num,  numl,  num2 
Integer  dev,  minim,  maxim,  first,  second,  minpts 
Logical  centre,  choice,  fixed,  prvchk,  ncheck,  nreduc 
Logical  Ql.  Q2,  Q3,  Q4,  Q5,  Q6,  minchk 
Real  tempy(6.nmax),  tempx(6,nmax) 

Real  stcurx(lOOO).  stcury(lOOO),  stprvx(lOOO).  stprvy(lOOO) 

Real  xmax,  xmin.  ymax,  ymin,  a,  b.  pi,  zero,  csiz,  zerox 

pi  =  3.1415926 
fixed  **  .true, 
countl  *  0 
count2  =  0 
numl  =  0 
num2  -  0 
minpts  -  75 
zero  -  le-3 

If  (centre)  zero  -  3.0e-3 

zerox  -  15.0*zero 
ncoun  -  0 

Do  50,  i  —  1,  num 
Do  40.  j  -  1,  num 

If  (centre)  Then 

choice  -  ((abs(tempy(k-2.i)  -  tempy(k-l.j))  .It.  zero)  .and. 

1  (abs(tempx(k-2,i)  -  tempx(k-l.j))  .It.  zerox)) 

Else 

choice  -  (abs(tempy(k-2.i)  -  tempy(k-l.j))  .It.  zero) 

Endif 

If  (choice)  Then 
curr(ncoun)  -  j 
prev(ncoun)  -  i 
ncoun  -  ncoun  +  1 
Goto  50 
Endif 

Continue 

Continue 

If  (centre)  Then 

prvchk  =*  (prev(ncoun-l)-prev(l)  .It.  minpts) 

If  (prvchk)  ncoun  -  0 

Call  Zeroer(  ncoun  .zero  .fixed,  minpts) 

If  (.not.(fixed))  ncoun  -  0 


,v, 


Subroutine  Conver(a,b.n) 

Converts  an  array  to  a  two  dimensional  indexed  array 
Real  a(6,nmax),  b(nmax) 


Common  k.nmax 

Do  50,  i  =  1.  n 
a(k.i)  =  b(i) 
Continue 

Return 

End 


A  Program  For  Target  Tracking 
For  A  Case  Of  Translation 


program  main 

real  bmat(2),x(50),xp(50),y(50),yp(50),bl(20),b2(20) 

real  u(50),up(50),v(50),vp(50),rdelt(50),ralfa(50) 

real  idelt(50),lalfaC50),bsl(20)Ibs2(20),errorl(20),error2(20) 

common  /ab/  bmat(2) 

character  yn 

logical  flag 

flag-.false. 
sum-3.19 
del-.28 
sum  1-1. 9 
dell-.  18 

j-1 

do  10  i— 1.10 

bl(j)«sum-del 

b2(j)=suml-dell 

sum-bl(j) 

suml-b2(j) 

j-j+1 

10  continue 

sum-0, 
del— .28 
sum  1-0. 
dell— .18 
do  20  1—1.10 
bl(j)-sum+del 
b2(j)-suml+dell 
sum=bl(j) 
suml-b2(j) 
j-j+1 

20  continue 
io— 2 
m-8 

do  30  i-1,20 
bmat(l)=bl(i) 
bmat(2)=b2(i) 
call  image(x.y) 
call  wplane(u,v,x,y,m) 
call  pimage(mm,flag,xp,yp,x,y,m) 
call  wplane(up,vp,xp,yp,m) 
call  deltat(up,vp,u,v,rdelt,idelt,m) 
if(flag.eq..true.)then 
qq— yp(mm)/xp(mm) 
ideltC  mm )— atanCqq ) 


call  stp(x,y,p,ralfa,ialfa,m) 

call  q3q4(q3,q4,ralfa,ialfa,rdelt,idelt,m) 

call  aabb(bbl,bb2,p,q3,q4) 

bsl(i)=bbl 

bs2(i)=bb2 

errorl(i)=(bl(i)-bsl(i)) 

error2(i)-(b2(i)-bs2(i)) 

continue 

print  V  plot  bl’ 

read(5,101)yn 

format(al) 

call  plotbl(bl,bsl) 

print  V  plot  b2’ 

read(5,101)yn 

call  plotb2(b2,bs2) 

print  plot  error  for  bl’ 

read(5,101)yn 

call  plter l(bl, error  1) 

print  plot  error  for  b2’ 

read(5,101)yn 

call  plter2(b2,error2) 

stop 

end 


subroutine  pirnageCmm.flag.xp.yp.x.y.m) 
real  xp(50),yp(50),bmat(2),x(50),y(50) 
common  /ab/  bmat(2) 
logical  flag 

do  10  i=l,m 
xp(i)=x(i)+bmat(  1 ) 
yp(i)=y(i)+bmat(2) 
if(x(i).gt.0..and.y(i).eq.0.)then 
if(xp(i).gt.0..and.yp(i).lt.0.)then 
flag-.true. 
mm-i 
endif 
endif 
continue 
return 
end 

subroutine  wplane(xl,y I,x2,y2,n) 
real  xl(50),x2(50),y l(50),y2(50) 


pi-3.141592654 


do  1  i*»l,n 

if(x2(i).ne.0.0.or.y2(i).ne.0.0) 

+  xl(i)=alog(sqrt(x2(i)**2+y2(i)**2)) 
if(x2(i).eq.0.0.and.y2(i).gt.0.0)yl(i)=pi/2. 
if(x2(i).eq.0.0.and.y2(i).eq.0.0)then 
yl(i)=pi/2. 
xl(i)— 100000. 

endif 

if  (x2(i).eq.0.0.and.y2(i).lt.0.0)y  1(0=1. 5*pi 
if(x2(i).ne.0.0)then 
q=y2(i)/x2(i) 
if(x2(i).lt.0.0)then 
if(y2(0.gt.0.0)then 
q— q 

yl(i)=pi-atan(q) 

else 

if(y2(i).eq.0.0)y  l(i)=pi 
if(y2(i).lt.0.0)yl(i)=pi+atan(q) 
endif 

else 

if(x2(i).gt.0.0)then 

if(y2(i).gt.0.0)yl(i)=atan(q) 

if(y2(i).eq.0.0)yl(i)=0.0 

if(y2(i).lt.0.0)then 

q--q 

y  1(0=2. *pi-atan(q) 
endif 
endif 
endif 
endif 
continue 
return 
end 

subroutine  deltat(up,vp,u,v,rdelt,idelt,m) 

real  up(50),vp(50),u(50),v(50),rdelt(50),idelt(50) 

do  10  i-l.m 

rdelt(i)=up(i)-u(0 

idelt(i)=vp(i)-v(0 

continue 

return 

end 


subroutine  aabb(bl,b2,p,q3,q4) 


return 

end 

subroutine  stp(x,y ,p,ralf a.ialf a,m) 
real  x(50),y(50),ralfa(50),ialfa(50),r(50) 


p^O.O 

do  10  i— l,m 

r(  i  )=x(  i)**2+y(i)**2 
p=p+l./r(i) 
ralfaCi)=x(i)/r(i) 
ialfa(i)=-y(i)/r(i) 
continue 
return 
end 


subroutine  plotbl(x.y) 
real  x(20),y(20) 
character  yn 

print  V  4107  ?’ 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev=3 

if(yn.eq.’n’)  idev=2 

if(yn.ne.’y’.and.yn.ne.’n’)idev=4 

call  plots(idev) 

call  scrnpC.25,.7,.25,.75) 

call  paperC-4.5,4.5,-5.5,4.5) 

call  axis(-3.5,-3.5,19hDELTA  X  (estimated),  19, 7., 90., 

+-3.5, 1.5, .1,999,1) 

call  axis(-3.5,-3.5,20h  DELTA  X  (exact), -20, 7., 0., -3.5, 
+  1.5, .1,999,0) 

call  plot(-3.5,0.,3) 
call  plot(3.5,0.,2) 
call  plot(0.,-3.5,3) 
call  plot(0.,3.5,2) 
call  line(x,y, 20,1,0,4,1) 
call  line(y,y,20,l,0,4,0) 

call  symbol(2.,-2.5,.l,9h _  Exact,  1,0., 9) 

call  symbol(2.,-3.,.l,12h —  Estimate,l,0.,12) 

print  done  ?' 

read(5,100)yn 

call  plot(0.,0.,999) 

return 

end 


subroutine  plotb2(x,y) 


real  x(20),y(20) 
character  yn 


print  V  4107  ?’ 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev-3 

if(yn.eq.’n’)  idev=2 

ifCyn.ne.'y’.and.yn.ne.'nOidev^ 

call  plots(idev) 

call  scrnp(.25,.7,.25,.75) 

call  paper(-4.5,4.5,-5.5,4.5) 

call  axis(-3.5,-3.5,19hDELTA  Y  (estimated),  19, 7., 90., 
+-3.5, 1.5, .1,999,1) 

call  axis(-3.5,-3.5,15hDELTA  Y  (exact), -15, 7.,0., -3.5, 
+1.5, .1,999,0) 

call  plot(-3.5,0.,3) 
call  plot(3.5,0.,2) 
call  plot(0.,-3.5,3) 
call  plot(0.,3.5,2) 
call  line(x,y,20,l,0,4,l) 
call  line(y ,y ,20, 1 ,0,4,0) 

call  symbol(2.,-2.5,.l,9h _  Exact,  1,0., 9) 

call  symbol(2.,-3.,.l,12h —  Estimate,  1,0.,  12) 

print  done  ?’ 

read(5,100)yn 

call  plot(0.,0.,999) 

return 

end 

subroutine  plterl(x.y) 
real  x(20),y(20) 
character  yn 

print  V  4107  ?’ 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev-3 

if(yn.eq.’n’)  idev=2 

if(yn.ne.’y’-and.yn.ne.’n’)idev=4 

call  plots(idev) 

call  scrnp(.25,.7,.25,.75) 

call  paper(-4.5,4.5,-5.5,4.5) 

call  axis(-3.5,-3.5,5hERROR,5,7.,90.,-3.5, 1 .5,.  1 ,999, 1 ) 
call  axis(-3.5,-3.5,15hDELTA  X  (exact), -15, 7. ,0., -3.5, 
+  1.5, .1,999,0) 

call  plot(-3.5,0.,3) 
call  plot(3.5,0.,2) 


call  plot(0.,-3.5,3) 
call  plot(0.,3.5,2) 
call  lineCx.y, 20,1, 0,4,0) 
print  done  7 
read(5,l00)yn 
call  plot(0.,0.,999) 
return 
end 

subroutine  plter2(x,y) 
real  x(20),y(20) 
character  yn 

print  V  4107  7 
read(5,100)  yn 
format(al) 
if(yn.eq.’y’)  idev=3 

if(yn.eq.’n’)  idev=»2 
if(yn.ne.’y’.and.yn.ne.’n’)idev=4 
call  plots(idev) 
call  scrnp(.25,.7,.25,.75) 
call  paperC-4.5,4.5,-5.5,4.5) 

call  axisC -3.5,-3.5,5hERROR ,5, 7. , 90. , -3.5, 1 .5, .  1 ,999, 1 ) 
call  axisC -3.5, -3.5, l5hDELTA  Y  (exact), -15, 7., 0., -3.5, 
+1.5, .1,999,0) 

call  plot(-3.5,0.,3) 
call  plot(3.5,0.,2) 
call  plot(0.,-3.5,3) 
call  plot(0.,3.5,2) 
call  line(x,y,20,l,0,4,0) 
print  done  ?’ 
read(5,l00)yn 
call  plot(0.,0.,999) 
return 
end 

subroutine  image(x,y,m) 
real  x(50),y(50) 

x(l)-3. 
y(D=2. 
x(2)=-3. 
y(2)=2. 
x(3)=-3. 
y(3)-2. 
x(4)-3. 
y(4)— 2. 
x(5)=3. 


VS*. 


A  Program  For  Target  Tracking 
For  A  Case  Of  T ranslation  Rotation  and  Scaling 


I 


M 


v 
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program  main 

real  k,amat(2,2),bmat(2),x(50),xp(50)(y(50),yp(50) 

real  uC50),upC50),v(50),vp(50),rdelt(50),ralfa(50) 

real  idelt(50),ialf a(50),error3(6 1 ) 

real  error4(6 1  ),b3(6 1  ),b4(6 1  ),b5(6 1  ),b6(6 1  ),angle(6 1 ) 

integer  mm(  3  )  ,n  1  ( 1 0 )  ,n2(  1 0)  .count  1 ,count2 

common  /ab/  amat(2,2),bmat(2) 

character  yn 

logical  flagl  ,flag2,flag3,flag4,flag5 
c 

flag  1=.  false. 

flag2-.false. 

flag3=.false. 

flag4«.  false. 

flag5=.false. 

angle(O)— 15.5 

del=.5 

h=.5 

k-.5 

m-32 

io=2 

do  99  ii— 1,61 
angle(ii)=angle(ii-l  )+del 
theta-angle(ii) 

theta-3. 1 4 1 592654 *theta/ 1 80. 
call  amatx(  theta, h.k) 
call  image(x.y) 
call  wplane(u,v,x,y,m) 
call  pimage(mm,n  1  ,n2, count  1  ,count2,flag  1 , 
+flag2,flag3,flag4, flag5, xp.yp.x.y.m) 
call  wplane(up,vp,xp,yp,m) 
call  deltatCup,vpIu,v,rdelt,idelt,ql,q2,m) 
if(flagl.eq..true.)then 
qq— yp(mm(  1  ))/xp(mm(  1)) 
idelt(mm(  1 ))— atan(qq) 
flagl -.false, 
endif 

if(flag2.eq..true.)then 
do  41  i-1  .count  1 
qq-yp(nl(i))/xp(nl(i)) 
qq2— y(nl(i))/x(nl(i)) 
idelt(nl(i))-atan(qq)+atan(qq2) 

41  continue 

flag2=.false. 
endif 


if(flag3.eq..true.)then 
do  42  i-l,count2 
qq— yp(n2(i))/xp(n2(0) 
qq2=y(n2(i))/x(n2(i)) 
idelt(n2(i))— (atan(qq)+atan(qq2)) 
continue 
flag3=.false. 
endif 

if(flag4.eq..true.)then 
qq=-y(mm(2))/x(mm(2)) 
idelt(mm(2))=atan(qq) 
flag4=-. false, 
endif 

if(flag5.eq..true.)then 
qq=y(mm(3))/x(mm(3)) 
ideltC  mm(  3  )  )— atan(qq) 
flag5-.false. 
endif 

call  stp(x.y,s,t,p,ralfa,ialfa,m) 

call  q3q4(q3,q4,ralfa,ialfa,rdeit,idelt,m) 

call  aabb(a  1  ,a2 ,b  1  ,b2,s,t,p,q  1  ,q2,q3  ,q4) 

b3(ii)=bl 

b4(ii)=-b2 

b5Cii)=bmat(l) 

b6(il)=bmat(2) 

error3(ii)-=bmat(l)-bl 

error4(ii)=bmat(2)-b2 

continue 

print  plot  bl  ?’ 

read(5,100)yn 

format(al) 

if(yn.eq.’y’)call  plotbl(angle,b3,b5) 
print  plot  b2  ?’ 

read(5,100)yn 

if(yn.eq.’y’)call  plotb2(angle,b4,b6) 
print  *  ’  plot  error  for  bl  ?’ 
read(5,100)yn 

if(yn.eq.’y’)call  plterl(angle,error3) 
print  plot  error  for  b2  ?’ 

read(5,100)yn 

if(yn.eq.’y’)call  plter2(angle,error4) 

stop 

end 


subroutine  pimageCmm, nl,n2, count l,count2,flagl, 
+flag2,flag3,flag4,flag5,xp,yp,x,y(m) 
real  xp(50)(yp(50),amat(2,2)(bmatC2).x(50),y(50) 

integer  mm(3).n  1(  10).n2(  10), count  1  ,count2 


common  /ab/  amat(2,2),bmat(2) 
logical  flagl,flag2,flag3,flag4,flag5 

count 1=0 
count2=0 
do  10  i=l,m 

xp(i)=amat(  1 , 1  )*x(i)+amat(  1 ,2)*y  (i)+bmat(  1 ) 
yp(i)=amat(2,l)*x(i)+amat(2,2)*y(i)+bmat(2) 
if(x(i).gt.0..and.y(i).eq.0jthen 
if(xp(i).gt.0..and.yp(i).lt.0.)then 
flag  1=.  true. 
mm(l)=i 
endif 
endif 

if(x(i).gt.0..and.y(i).lt.0.)then 
if(xp(i).gt.0..and.yp(i).gt.0.)then 
flag2=.true. 
count  1 -count  1+1 
nl(countl)=i 
endif 
endif 

if(x(0.gt.0..and.y(i).lt.0.)then 

if(xp(i).gt.0..and.yp(i).eq.0.)then 

flag4=.true. 

mm(2)=i 

endif 

endif 

if(x(i).gt.0..and.y(i).gt.0.)then 
if(xp(i).gt.0..and.yp(i).lt.0.)then 
flag3=.true. 
count2=count2+ 1 
n2(count2)=i 
endif 
endif 

if(x(i).gt.0..and.y(i).gt.0.)then 

if(xp(i).gt.0..and.ypCi).eq.O.)then 

flag5=.true. 

mm(3)=i 

endif 

endif 

continue 

return 

end 

subroutine  wplane(xl,yl,x2,y2,n) 
real  xl(50),x2(50),y l(50),y2(50) 


pi-3.141592654 


do  1  i-l,n 

if(x2(i).ne.0.0.or.y2(i).ne.0.0) 

+  .  xl(i)=alog(sqrt(x2(i)**2+y2(i)**2)) 

if(x2(i).eq.0.0.and.y2Ci).gt.0.0)ylCi)=pi/2. 
if(x2(i).eq.0.0.and.y2(i).eq.0.0)then 
yl(i)=pi/2. 
x  1(0—100000. 
endif 

if  (x2(i).eq.0.0.and.y2(i).lt.0.0)y  1(0=1 .5*pi 
if(x2(i).ne.0.0)then 
q«=y2(i)/x2(i) 
if(x2(i).lt.0.0)then 
if(y2(i).gt.0.0)then 

q=-q 

yl(0=pi-atan(q) 

else 

if(y2(0.eq.0.0)yl(i)=pi 

if(y2(i).lt.0.0)yl(i)-pi+atan(q) 

endif 

else 

if(x2(i).gt.0.0)then 

if(y2(i).gt.O.O)yl(0=atan(q) 
if(y2(i).eq.0.0)yl(i)-0.0 
if  (y  2(i).  lt.0.0)then 
q— q 

y  l(i)=2.*pi-atan(q) 
endif 
endif 
endif 
endif 
continue 
return 
end 

subroutine  q3q4(q3,q4,ralfa,ialfa,rdelt,idelt,m) 
real  ralfa(50),ialfa(50),rdelt(50),idelt(50) 

q3-0.0 
q4=0.0 
do  10  i-l,m 

q3=q3+rdelt(0*ralfa(i)+idelt(i)*lalfa(i) 

q4-q4+idelt(i)*ralfa(i)-rdelt(i)*ialfa(i) 

continue 

return 

end 

subroutine  deltat(up,vp,u,v.rdelt,idelt>ql,q2,m) 
real  up(50),vp(50),u(50),v(50),rdell(50),idelt(50) 


do  10  i=l,m 
rdelt(i  )=»up(  i  )-u(  i ) 
ql=ql+rdelt(i) 
idelt(i)-vp(i)-v(i) 
q2=q2+idelt(i) 
continue 
return 
end 

subroutine  aabb(a  1  ,a2,b  1  ,b2 ,s,t(p,q  1  ,q2 ,q3 ,q4) 

del=s**2+t**2-p 
a  1  «=(-q  1  *p+q3*s+q4*t)/del+ 1 . 

a2=(-q3*t+q4*s-q2*p)/del 
b  l=(q  1  *s-q3-q2*t)/del 
b2=(q  1  *t-q4+q2*s  )/del 
return 
end 

subroutine  stp(x,y,s,t,p,ralfa,ialfa,m) 
real  x(50),y(50),ralfa(50),ialfa(50),r(50) 

p=0.0 

s=0.0 

t=*0.0 

do  10  i-l,m 

r(i)=x(i)**2+y(i)**2 

p=p+l./r(i) 

ralfa(i)=’x(i)/r(i) 

ialfa(i)=-y(i)/r(i) 

s=s+ralfa(i) 

t=*t-ialfa(i) 

continue 

return 

end 

subroutine  amatx(  theta, h,k) 
real  amat(2,2),bmat(2),k 
common  /ab/  amat(2,2),bmat(2) 

amatC  1 , 1  )-cos(  theta) 

amat(2,2)«amat(  1,1) 

amat(2,l)-sin(  theta) 

amat(  1 ,2)— amat(2, 1 ) 

bmatC  1 )-( 1  .-amatC  1 , 1  ))*h+amat(  2, 1  )*k 


bmat(2)=amat(  1 ,2)*h+(  l.-amat(  1 , 1  ))*k 

return 

end 

subroutine  plotbl(x,y,z) 
real  x(6l),y(61),z(6l) 
character  yn 

print  *,*  4107  ?’ 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev=3 

if(yn.eq.’n’)  idev*2 

ifCyn.ne.’y’.and.yn.ne.’nOldev^ 

call  plots(idev) 

call  scrnp(.3,.7,.3,.75) 

call  paper(-22.,19.,-.45,.30) 

call  axis(-l6.,-.25,7hDELTA  X, 7, .5, 90., -.25, .15, .1,999,1) 
call  axisC-16.,-.25,14hANGLE  (DEGREE), -14, 32..0., -16., 8., .1,999,0) 
call  plot(-16.,0.,3) 
call  plot(16.,0.,2) 
call  plot(0.,-.25,3) 
call  plot(0.,.25,2) 
call  line(x,y ,61,1,0,4,1) 
call  line(x,z,61,l,0,4,0) 

call  symbol(6.,.24,.l,9h _  Exact,  1,0., 9) 

call  symbol(6.,.19,.l,12h —  Estimate,  1,0.,  12) 

print  done  ?’ 

read(5,100)yn 

call  plot(18.,.18,999) 

return 

end 

subroutine  plotb2(x,y,z) 
real  x(61),y(6l),z(6l) 
character  yn 

print  V  4107  ?' 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev-3 

if(yn.eq.’n’)  idev-2 

if(yn.ne.’y’.and.yn.ne.’n’)idev-4 

call  plots(idev) 

call  scrnp(.3,.7,.3,.75) 

call  paper(-22.,19.,-.45,.30) 

call  axis(-16.,-.25,7hDELTA  Y, 7, .5, 90., -.25, .15, .1,999,1) 
call  axis(-l6.,-.25,14hANGLE  (DEGREE), -14, 32., 0., -16., 8., .1,999,0) 


bmat(2)=amat(  1 ,2)*h+(  1  .-amat(  1 , 1  ))*k 

return 

end 

subroutine  plotbl(x,y,z) 
real  x(6l),y(6l),z(61) 
character  yn 

print  *,*  4107  ?* 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev*=3 

if(yn.eq.’n’)  idev-2 

if(yn.ne.’y’.and.yn.ne.’n’)idev=4 

call  plots(idev) 

call  scrnp(.3,.7,.3,.75) 

call  paper(-22.,19.,-.45,.30) 

call  axis(-16.,-.25,7hDELTA  X, 7, .5, 90., -.25,.  15,.  1,999,1) 
call  axis(-16.,-.25,14hANGLE  (DEGREE), -14, 32., 0., -16., 8., .1,999,0) 
call  plot(-16.,0.,3) 
call  plot(16.,0.,2) 
call  plot(0.,-.25,3) 
call  plot(0.,.25,2) 
call  line(x,y ,61,1, 0,4,1) 
call  line(x,z,6l,l,0,4,0) 

call  symbol(6.,.24,.l,9h _  Exact, 1,0., 9) 

call  symbol(6.,.19,.l,12h —  Estimate,  1,0.,  12) 

print  done  ?’ 

read(5,100)yn 

call  plot(18.,.18,999) 

return 

end 

subroutine  plotb2(x,y,z) 
real  x(61),y(61),z(6l) 
character  yn 

print  4107  ?’ 

read(5,100)  yn 

format(al) 

if(yn.eq.’y’)  idev-3 

if(yn.eq.'n’)  idev-2 

lf(yn.ne.’y’.and.yn.ne.’n’)idev-4 

call  plots(idev) 

call  scrnp(.3,.7,.3,.75) 

call  paper(-22.,19.,-.45,.30) 

call  axis(-16.,-.25,7hDELTA  Y, 7, .5, 90., -.25, .15, .1,999,1) 
call  axis(-16.,-.25,14hANGLE  (DEGREE), -14, 32., 0.,- 16., 8...  1,999,0) 


call  plot(-l6.,0.,3) 
call  plot(16.,0.,2) 
call  plot(0.,-.25,3) 
call  plot(0.,.25,2) 
call  line(x,y, 61,1, 0,4,1) 
call  line(x,z,6l,l,0,4,0) 

call  symbol(6...24,.l,9h _  Exact,  1,0., 9) 

call  symbol(6.,.19,.l,12h —  Estimate,  1,0.,  12) 

print  done  ?’ 

read(5,100)yn 

call  plot(  18... 18,999) 

reiurn 

end 

subroutine  plterl(x.y) 
real  x(6l),y(6l) 
character  yn 
c 

print  4107  ?' 

read(5,100)  yn 
100  format(al) 

if(yn.eq.’y’)  idev-3 
if(yn.eq.'n’)  idev-2 
ifCyn.ne.’y’.emd.yn.ne.’nOidev^ 
call  plots(idev) 
call  scrnp(.3,.7,.3,.75) 
call  paper(-22.,  19..-.45..30) 
call  axis(-16.,-.25,5hERROR,5,.5,90.,-.25,.15,.l,999,l) 
call  axis(-16.,-.25,14hANGLE  (DEGREE), -14, 32., 0., -16., 8., .1,999  0) 
call  plot(-16.,0.,3) 
call  plot(16.,0.,2) 
call  plot(0.,-.25,3) 
call  plot(0.,.25,2) 
call  line(x,y ,61,1,0,4,0) 
print  done  ?’ 
read(5,100)yn 
call  plot(18.,. 18,999) 
return 
end 

subroutine  plter2(x,y) 
real  x(61),y(61) 
character  yn 

print  •/  4107  ?’ 
read(5,100)  yn 
format(al) 
if(yn.eq.'y’)  idev-3 


100 


if(yn.eq.’n’)  idev-2 

if(yn.ne.’y’.and.yn.ne.’n’)idev=4 

call  piots(idev) 

call  scrnp(.3,.7,.3,.75) 

call  paper(-22.,19.,-.45,.30) 

call  axis(-l6.,-.25,5hERROR,5,.5,90.,-.25,.15,.l,999,l) 
call  axls(-l6. ,-.25,14hANGLE  (DEGREE), -14, 32.,0., -16., 8., .1,999,0) 
call  plot(-16.,0.,3) 
call  plot(16.,0.,2) 
call  plot(0.,-.25,3) 
call  plot(0.,.25,2) 
call  line(x,y,61,l,0,4,0) 
print  done  ?’ 
read(5,100)yn 
call  plot(18.,.18,999) 
return 
end 


subroutine  image(x,y) 
real  x(50),y(50) 

x(  1  )=3. 
y(l)-2. 
x(2)— 3. 
y(2)-2. 
x(3)=—3. 
y(3)— 2. 
x(4)=«3. 
y(4)=-2. 

x(5)=3. 
y(5)=0. 
x(6)=0. 
y(6)=2. 
x(7)=—3. 
y(7)=0. 
x(8)=0. 
y(8)=— 2. 
y(9)-l. 
x(9)=3. 
x(l0)=— 3. 
y(10)»l. 
x(ll)-3. 
y(ll)— 1. 
x(12)— 3. 
y(12)— 1. 
x(13)-l.5 
y(13)=2, 
x(14)=-1.5 


Figure  B2.  Structural  Design  Featuring  Rectangular  Elements 
Computational  Plane. 


Figure  B3.  Structural  Design  Featuring  Circular  Elements. 

Image  Plane. 


Figure  B4.  Structural  Design  Featuring  Circular  Elements. 
Computational  Plane. 
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